00000001:02000400:2.0F:1788197280.680732:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788197300.078601:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788197302.086864:0:3230:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 636 MB/s 00000001:01000000:0.0:1788197302.338308:0:3230:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 565 MB/s 00000001:01000000:2.0:1788197302.588687:0:3230:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4115 MB/s 00000020:02000000:2.0:1788197303.468820:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g9c33a22 00000400:02000000:3.0F:1788197304.289724:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.140@tcp [8/256/0/180] 00008000:02000000:2.0:1788197308.077212:0:3445:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1788197363.246393:0:5249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788197375.359876:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788197375.359882:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788197375.360033:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000045f95d8e 00000080:02000400:0.0:1788197375.360043:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788197375.372392:0:5822:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788197375.372409:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788197375.372453:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000050e55f20) 00000020:00000080:0.0:1788197375.372477:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788197375.451290:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788197375.451737:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788197375.513779:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788197375.513839:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788197375.513867:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788197375.513928:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788197375.513956:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788197375.516673:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788197375.516684:0:5822:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788197375.516697:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292402fcbf 00000020:01000004:3.0:1788197375.516704:0:5822:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788197375.516709:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788197375.516713:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000045f95d8e from MGS 00000020:01000004:3.0:1788197375.516717:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788197375.516740:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c0f36f7b) 00000020:00000080:3.0:1788197375.516761:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788197375.524870:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045f95d8e from MGS, refs=2 00080000:01000000:1.0:1788197375.524887:0:5822:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788197375.524899:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292402fccd 00000100:00100000:1.0:1788197375.525050:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788197375.525192:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788197375.525198:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788197375.527498:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788197375.527511:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788197375.528416:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197375.528797:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788197375.528803:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788197375.542647:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788197375.542665:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788197375.543215:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788197375.543222:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788197375.565768:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197375.565776:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197375.565778:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197375.566396:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197375.566399:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197375.566400:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197375.567515:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788197375.571882:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788197375.817098:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2787 MB/s 00000001:01000000:1.0:1788197376.066915:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3019 MB/s 00000001:01000000:2.0:1788197376.317552:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 531 MB/s 00000001:01000000:3.0:1788197376.567337:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 747 MB/s 00080000:10000000:1.0:1788197376.578214:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788197376.592099:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788197376.592115:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788197376.592117:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788197376.594389:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788197376.594467:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788197376.594549:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788197376.594930:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788197376.594960:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788197376.595275:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788197376.595447:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788197376.595452:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788197376.601197:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788197376.601209:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788197376.613354:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788197376.613367:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788197376.614927:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788197376.614949:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.140@tcp' 00000020:01000004:0.0:1788197376.614951:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788197376.614997:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.140@tcp (typ=mgc) 00000020:00000080:0.0:1788197376.615008:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.140@tcp (00000000f97f4474) 00000020:00000080:0.0:1788197376.615027:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1788197376.615768:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1788197376.615962:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000099f5bf3c@MGC192.168.206.140@tcp: add connection 192.168.206.140@tcp at head 00010000:00010000:0.0:1788197376.616125:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.140@tcp-0 is initialized 00000040:01000000:0.0:1788197376.616131:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 1 is initialized 00010000:00010000:2.0:1788197376.628888:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788197376.630328:0:5839:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788197376.630381:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.140@tcp (uuid 3d1c03da-de40-4aeb-8e95-9670c13aad9c) 00000020:00000080:3.0:1788197376.630402:0:5822:0:(genops.c:1385:class_connect()) connect: client 3d1c03da-de40-4aeb-8e95-9670c13aad9c, cookie 0x167e6c292402fcdb 00000100:00080000:3.0:1788197376.630414:0:5822:0:(import.c:510:import_select_connection()) MGC192.168.206.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788197376.630418:0:5822:0:(import.c:624:import_select_connection()) MGC192.168.206.140@tcp: import 0000000099f5bf3c using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197376.630457:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d5e392bd x1875060776239232/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788197376.630494:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS 00000020:01000004:3.0:1788197376.630509:0:5822:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788197376.630514:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788197376.630526:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c79c38d8) 00000020:00000080:3.0:1788197376.630542:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788197376.631864:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5e392bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3310:1875060776239232:0@lo:250: 00000100:00100000:1.0:1788197376.631952:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197376.632053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776239232 00000100:00100000:1.0:1788197376.632059:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776239232 00000100:00100000:1.0:1788197376.632096:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197376.632102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eeeafdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875060776239232:12345-0@lo:250: 00010000:00080000:1.0:1788197376.632124:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3d1c03da-de40-4aeb-8e95-9670c13aad9c@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1788197376.632166:0:5833:0:(genops.c:1385:class_connect()) connect: client 3d1c03da-de40-4aeb-8e95-9670c13aad9c, cookie 0x167e6c292402fce9 00000100:00080000:1.0:1788197376.632279:0:5833:0:(import.c:65:import_set_state_nolock()) 0000000021011fbf : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197376.632326:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eeeafdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:3310:x1875060776239232:12345-0@lo:250: Request processed in 223us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197376.632333:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197376.632375:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788197376.632382:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.140@tcp: connect to target with instance 0 00000100:00080000:1.0:1788197376.632394:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788197376.632397:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788197376.632413:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000099f5bf3c MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788197376.632416:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788197376.632423:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788197376.632427:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5e392bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3310:1875060776239232:0@lo:250: 00000100:00100000:0.0:1788197376.658873:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788197376.659105:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788197376.659112:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788197376.660088:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788197376.660100:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788197376.660923:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788197376.661120:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788197376.662234:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788197376.662426:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788197376.662431:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788197376.665731:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788197376.665754:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788197376.712435:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788197376.712709:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788197376.712715:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788197376.714673:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788197376.714685:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788197376.715486:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788197376.715709:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788197376.715715:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788197376.716264:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788197376.716271:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788197376.719657:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788197376.719938:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788197376.719947:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788197376.726985:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788197376.727001:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788197376.727683:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788197376.728099:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788197376.728105:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788197376.728657:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788197376.728665:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788197376.754500:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788197376.755380:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788197376.755389:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788197376.758478:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788197376.758494:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788197376.759657:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788197376.759668:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788197376.762243:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788197376.762370:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788197376.762379:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788197376.762608:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788197376.762648:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788197376.762653:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788197376.762655:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788197376.762657:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197376.762658:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788197376.762660:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197376.762661:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197376.762662:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788197376.762663:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788197376.762665:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788197376.762666:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788197376.762667:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197376.762668:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788197376.762671:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788197376.762673:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788197376.762674:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788197376.762675:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197376.762676:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788197376.762677:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197376.762678:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197376.762679:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788197376.762680:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788197376.762681:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788197376.762685:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788197376.762686:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197376.762687:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788197376.762713:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788197376.762730:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239360:0@lo:253: 00000100:00100000:3.0:1788197376.762967:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197376.763135:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027d0ef08 going to sleep for 11 seconds 00000100:00100000:0.0:1788197376.763277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776239360 00000100:00100000:0.0:1788197376.763287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776239360 00000100:00100000:0.0:1788197376.763371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197376.763380:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c1755b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:5822:x1875060776239360:12345-0@lo:253: 20000000:01000000:0.0:1788197376.763429:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788197376.763432:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788197376.764209:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788197376.764268:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788197376.764650:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788197376.766200:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788197376.766758:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788197376.766764:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788197376.766770:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788197376.766772:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788197376.766788:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788197376.767415:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197376.767816:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788197376.768106:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788197376.768159:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788197376.768209:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788197376.768241:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788197376.768361:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788197376.768370:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788197376.768412:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788197376.768419:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788197376.768446:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788197376.768452:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788197376.768478:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788197376.768607:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788197376.768640:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788197376.768650:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788197376.768665:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197376.769245:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788197376.769258:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788197376.769299:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788197376.769333:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788197376.769380:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788197376.769393:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788197376.769483:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788197376.769491:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788197376.769635:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788197376.769679:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788197376.770310:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788197376.770328:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788197376.770467:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788197376.770478:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788197376.770509:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788197376.770624:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788197376.770880:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788197376.771193:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788197376.771201:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788197376.772209:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788197376.772595:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788197376.772628:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.140@tcp for mdt 20000000:01000000:3.0:1788197376.772631:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:3.0:1788197376.772668:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788197376.772676:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788197376.772703:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788197376.772709:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:3.0:1788197376.772758:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788197376.772768:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788197376.772796:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788197376.772865:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788197376.772942:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788197376.772945:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788197376.772950:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788197376.772955:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788197376.773592:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788197376.773771:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788197376.785119:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788197376.785169:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1788197376.785244:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1788197376.785263:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788197376.785266:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788197376.785270:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788197376.785281:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788197376.785284:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788197376.785314:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788197376.785317:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788197376.786271:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788197376.786612:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788197376.786661:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788197376.786728:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1788197376.786753:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788197376.786755:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788197376.787315:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788197376.788272:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788197376.788329:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788197376.788365:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788197376.788379:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788197376.788382:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788197376.788388:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788197376.788407:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788431:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788441:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788447:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788453:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788458:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788464:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c670931 already unused, calling callback (0000000086da6de3) 00010000:00010000:0.0:1788197376.788468:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788475:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788486:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788493:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197376.788498:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c670931/0x167e6c292402fcf0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788197376.788593:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788197377.120946:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c1755b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:5822:x1875060776239360:12345-0@lo:253: Request processed in 357561us (357973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.120961:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197377.121065:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239360:0@lo:253: 10000000:01000000:3.0:1788197377.121081:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788197377.121086:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788197377.121088:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788197377.121089:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197377.121090:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788197377.121091:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197377.121092:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197377.121101:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788197377.121102:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788197377.121104:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788197377.121105:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197377.121107:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788197377.121130:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000045f95d8e from lustre-MDT0000 10000000:01000000:3.0:1788197377.121159:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788197377.121163:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788197377.121168:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93c70623b370 10000000:01000000:3.0:1788197377.121172:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788197377.121181:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c70623b370 from 1 10000000:01000000:3.0:1788197377.121184:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788197377.121220:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000591742ea/0x167e6c292402fcf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.121229:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000591742ea/0x167e6c292402fcf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.121237:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000591742ea/0x167e6c292402fcf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.121252:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239488:0@lo:101: 00000100:00100000:3.0:1788197377.121283:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.121340:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085ce7b1d going to sleep for 11 seconds 00000100:00100000:2.0:1788197377.121411:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776239488 00000100:00100000:2.0:1788197377.121418:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776239488 00000100:00100000:2.0:1788197377.121465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788197377.121473:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000309a6189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:5822:x1875060776239488:12345-0@lo:101: 00010000:00010000:2.0:1788197377.121484:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197377.121495:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a48290da/0x167e6c292402fcfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fcf7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.121517:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a48290da/0x167e6c292402fcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.121688:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a48290da/0x167e6c292402fcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.121697:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a48290da, rc 0) 00000100:00100000:2.0:1788197377.121750:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000309a6189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+6:5822:x1875060776239488:12345-0@lo:101: Request processed in 268us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197377.121756:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788197377.121868:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239488:0@lo:101: 00010000:00010000:3.0:1788197377.121882:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000591742ea/0x167e6c292402fcf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.121891:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000591742ea/0x167e6c292402fcf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.121935:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239616:0@lo:501: 00000100:00100000:3.0:1788197377.121967:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.121989:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085ce7b1d going to sleep for 11 seconds 00000100:00100000:3.0:1788197377.122007:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776239616 00000100:00100000:3.0:1788197377.122011:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776239616 00000100:00100000:3.0:1788197377.122030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197377.122035:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c61ccedf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+6:5822:x1875060776239616:12345-0@lo:501: 00000100:00100000:3.0:1788197377.122223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c61ccedf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+6:5822:x1875060776239616:12345-0@lo:501: Request processed in 188us (255us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788197377.122230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197377.122256:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239616:0@lo:501: 10000000:01000000:3.0:1788197377.122275:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788197377.122286:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000591742ea/0x167e6c292402fcf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122293:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000591742ea/0x167e6c292402fcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197377.122300:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c706bce800 10000000:01000000:3.0:1788197377.122304:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788197377.122307:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c706bce800 10000000:01000000:3.0:1788197377.122309:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788197377.122312:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93c706bce800 from 1 10000000:01000000:3.0:1788197377.122314:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788197377.122328:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 000000004717ebee/0x167e6c292402fd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122334:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 000000004717ebee/0x167e6c292402fd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122349:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 000000004717ebee/0x167e6c292402fd05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.122360:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239744:0@lo:101: 00000100:00100000:3.0:1788197377.122382:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.122393:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085ce7b1d going to sleep for 11 seconds 00000100:00100000:3.0:1788197377.122404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776239744 00000100:00100000:3.0:1788197377.122408:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776239744 00000100:00100000:3.0:1788197377.122423:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197377.122428:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5eb260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+6:5822:x1875060776239744:12345-0@lo:101: 00010000:00010000:3.0:1788197377.122434:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197377.122443:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a4c6422/0x167e6c292402fd0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fd05 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122456:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a4c6422/0x167e6c292402fd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fd05 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122464:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a4c6422/0x167e6c292402fd0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd05 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122470:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a4c6422, rc 0) 00000100:00100000:3.0:1788197377.122495:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5eb260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+7:5822:x1875060776239744:12345-0@lo:101: Request processed in 68us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197377.122501:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197377.122755:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239744:0@lo:101: 00010000:00010000:3.0:1788197377.122765:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 000000004717ebee/0x167e6c292402fd05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122783:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 000000004717ebee/0x167e6c292402fd05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197377.122794:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788197377.122937:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 000000004717ebee/0x167e6c292402fd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122945:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 000000004717ebee/0x167e6c292402fd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197377.122950:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788197377.122954:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788197377.122958:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c706bce800 10000000:01000000:3.0:1788197377.122961:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788197377.122964:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788197377.122966:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788197377.122978:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 000000008fd86485/0x167e6c292402fd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122984:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 000000008fd86485/0x167e6c292402fd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.122991:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 000000008fd86485/0x167e6c292402fd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.123002:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239872:0@lo:101: 00000100:00100000:3.0:1788197377.123029:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.123094:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085ce7b1d going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.123143:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776239872 00000100:00100000:0.0:1788197377.123148:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776239872 00000100:00100000:0.0:1788197377.123217:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788197377.123226:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b68675d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+7:5822:x1875060776239872:12345-0@lo:101: 00010000:00010000:0.0:1788197377.123235:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197377.123242:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c670931/0x167e6c292402fd1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fd13 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.123257:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c670931/0x167e6c292402fd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fd13 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.123265:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c670931/0x167e6c292402fd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd13 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.123271:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c670931, rc 0) 00000100:00100000:0.0:1788197377.123323:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b68675d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+8:5822:x1875060776239872:12345-0@lo:101: Request processed in 98us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.123330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788197377.123394:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776239872:0@lo:101: 00010000:00010000:3.0:1788197377.123404:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 000000008fd86485/0x167e6c292402fd13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.123411:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 000000008fd86485/0x167e6c292402fd13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.123454:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240000:0@lo:501: 00000100:00100000:3.0:1788197377.123479:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.123563:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085ce7b1d going to sleep for 11 seconds 00000100:00100000:2.0:1788197377.123693:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240000 00000100:00100000:2.0:1788197377.123698:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240000 00000100:00100000:2.0:1788197377.123720:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788197377.123725:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048ee13f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+8:5822:x1875060776240000:12345-0@lo:501: 00000100:00100000:2.0:1788197377.123998:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048ee13f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5822:x1875060776240000:12345-0@lo:501: Request processed in 272us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197377.124005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788197377.124078:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240000:0@lo:501: 00000100:00100000:3.0:1788197377.124103:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240128:0@lo:503: 00000100:00100000:3.0:1788197377.124135:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.124161:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085ce7b1d going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.124208:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240128 00000100:00100000:0.0:1788197377.124213:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240128 00000100:00100000:0.0:1788197377.124233:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788197377.124238:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e57ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5822:x1875060776240128:12345-0@lo:503: 00000100:00100000:0.0:1788197377.124387:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e57ad7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5822:x1875060776240128:12345-0@lo:503: Request processed in 149us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.124400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788197377.124470:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240128:0@lo:503: 00000100:00100000:2.0:1788197377.124896:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc896305 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5864:1875060776240256:0@lo:502: 00000100:00100000:2.0:1788197377.124928:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197377.124955:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fb145c5 going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.125000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240256 00000100:00100000:0.0:1788197377.125004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240256 00000100:00100000:0.0:1788197377.125029:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788197377.125034:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8427f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5864:x1875060776240256:12345-0@lo:502: 00000100:00100000:0.0:1788197377.125212:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8427f91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5864:x1875060776240256:12345-0@lo:502: Request processed in 177us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.125219:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788197377.125382:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc896305 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5864:1875060776240256:0@lo:502: 00000020:01000000:3.0:1788197377.125404:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197377.125415:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197377.125418:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788197377.125423:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788197377.125426:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788197377.125437:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000cad6eec1) 00000020:00000080:3.0:1788197377.125453:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788197377.125458:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788197377.125593:0:5864:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788197377.125599:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292402fd28 00000020:00000080:3.0:1788197377.125807:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788197377.125811:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197377.125848:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197377.125850:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788197377.125853:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197377.125857:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197377.125858:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788197377.125861:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788197377.125866:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009b4d690c) 00000020:00000080:3.0:1788197377.125875:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788197377.125878:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788197377.125879:0:5864:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788197377.125881:0:5864:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788197377.125886:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788197377.125921:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045f95d8e from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788197377.125938:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004db688b8) 00000020:00000080:3.0:1788197377.125945:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788197377.125995:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788197377.125999:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c292402fd3d 00000020:00000080:3.0:1788197377.126079:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788197377.126083:0:5864:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788197377.126087:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x167e6c292402fd44 00080000:01000000:3.0:1788197377.126090:0:5864:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788197377.126092:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292402fd4b 00080000:10000000:3.0:1788197377.126416:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788197377.126791:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788197377.130351:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788197377.203870:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788197377.204230:0:5864:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788197377.207332:0:5864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788197377.207620:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788197377.242939:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000602fe93d) 00000020:00000080:1.0:1788197377.242960:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788197377.243036:0:5864:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788197377.243043:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292402fd59 00000020:00000080:1.0:1788197377.245847:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788197377.247072:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788197377.332947:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788197377.373380:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788197377.417237:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788197377.470989:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197377.528177:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788197377.561759:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x167e6c292402fd60 00000020:00000080:3.0:1788197377.562199:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788197377.562208:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197377.562214:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197377.562216:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788197377.562220:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197377.562225:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197377.562232:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788197377.562237:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788197377.562274:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788197377.562289:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197377.562293:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197377.562294:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788197377.562296:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197377.562299:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197377.562300:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788197377.562303:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788197377.562304:0:5864:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788197377.562343:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5864:1875060776240384:0@lo:502: 00000100:00100000:3.0:1788197377.562418:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.562471:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085ce7b1d going to sleep for 11 seconds 00000100:00100000:1.0:1788197377.562649:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240384 00000100:00100000:1.0:1788197377.562657:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240384 00000100:00100000:1.0:1788197377.562714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788197377.562722:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c99f88d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5864:x1875060776240384:12345-0@lo:502: 00000100:00100000:1.0:1788197377.563427:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c99f88d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5864:x1875060776240384:12345-0@lo:502: Request processed in 703us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197377.563437:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788197377.563645:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061b38ac6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5864:1875060776240384:0@lo:502: 00000020:01000000:0.0:1788197377.563674:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197377.563679:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197377.563681:0:5864:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788197377.563684:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788197377.563852:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788197377.563869:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788197377.563887:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 000000008fd86485/0x167e6c292402fd13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.563897:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 000000008fd86485/0x167e6c292402fd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197377.563904:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c706bce800 from 1 10000000:01000000:3.0:1788197377.563907:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788197377.564024:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.564032:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.564040:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.564171:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008681db4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240512:0@lo:101: 00000100:00100000:3.0:1788197377.564214:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.564248:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000001043d3cb going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.564347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240512 00000100:00100000:0.0:1788197377.564355:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240512 00000100:00100000:0.0:1788197377.564389:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788197377.564397:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015a0aea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:5822:x1875060776240512:12345-0@lo:101: 00010000:00010000:0.0:1788197377.564412:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197377.564428:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fd67 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.564456:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fd67 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.564465:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd67 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.564487:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ad38f41, rc 0) 00000100:00100000:0.0:1788197377.564538:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015a0aea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:5822:x1875060776240512:12345-0@lo:101: Request processed in 141us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.564545:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788197377.564756:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008681db4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240512:0@lo:101: 00010000:00010000:3.0:1788197377.564768:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.564776:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.565767:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008681db4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240640:0@lo:256: 00000100:00100000:3.0:1788197377.565851:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.565879:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000001043d3cb going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.566283:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240640 00000100:00100000:0.0:1788197377.566292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240640 00000100:00100000:0.0:1788197377.566339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788197377.566349:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0093ee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:5822:x1875060776240640:12345-0@lo:256: 20000000:01000000:0.0:1788197377.566369:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788197377.566378:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788197377.566468:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0093ee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:5822:x1875060776240640:12345-0@lo:256: Request processed in 121us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.566476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788197377.566718:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008681db4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240640:0@lo:256: 10000000:01000000:3.0:1788197377.567769:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788197377.567887:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.567899:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197377.567908:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c706bce800 from 1 10000000:01000000:3.0:1788197377.567910:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788197377.568017:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.568025:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.568045:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197377.568075:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008681db4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240768:0@lo:101: 00000100:00100000:3.0:1788197377.568132:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.568175:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000001043d3cb going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.568314:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240768 00000100:00100000:0.0:1788197377.568322:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240768 00000100:00100000:0.0:1788197377.568368:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788197377.568375:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000609d0978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:5822:x1875060776240768:12345-0@lo:101: 00010000:00010000:0.0:1788197377.568387:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197377.568399:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fd75 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.568419:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fd75 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.568427:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd75 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.568445:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a298ba88, rc 0) 00000100:00100000:0.0:1788197377.568486:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000609d0978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5822:x1875060776240768:12345-0@lo:101: Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.568492:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788197377.568646:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008681db4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240768:0@lo:101: 00010000:00010000:2.0:1788197377.568659:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.568667:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197377.568717:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cbbd96a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240896:0@lo:501: 00000100:00100000:2.0:1788197377.568755:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197377.568784:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074a7a967 going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.568921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776240896 00000100:00100000:0.0:1788197377.568939:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776240896 00000100:00100000:0.0:1788197377.568962:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788197377.568967:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bca2ee2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5822:x1875060776240896:12345-0@lo:501: 00000100:00100000:0.0:1788197377.569575:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bca2ee2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5822:x1875060776240896:12345-0@lo:501: Request processed in 606us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.569583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788197377.569902:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cbbd96a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776240896:0@lo:501: 00000100:00100000:2.0:1788197377.570023:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cbbd96a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241024:0@lo:503: 00000100:00100000:2.0:1788197377.570089:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197377.570229:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074a7a967 going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.570265:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241024 00000100:00100000:0.0:1788197377.570271:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241024 00000100:00100000:0.0:1788197377.570306:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788197377.570313:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df8e6927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5822:x1875060776241024:12345-0@lo:503: 00000040:00080000:0.0:1788197377.570353:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788197377.570399:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df8e6927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5822:x1875060776241024:12345-0@lo:503: Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.570405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788197377.570453:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cbbd96a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241024:0@lo:503: 00000040:00080000:3.0:1788197377.571734:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788197377.571967:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788197377.571989:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197377.572008:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.572018:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197377.572198:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788197377.572202:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c706bce800 10000000:01000000:0.0:1788197377.572205:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c706bce800 10000000:01000000:0.0:1788197377.572209:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788197377.572216:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c706bce800 from 1 10000000:01000000:0.0:1788197377.572219:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788197377.572270:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000d4346f17/0x167e6c292402fd83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.572279:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000d4346f17/0x167e6c292402fd83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.572288:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000d4346f17/0x167e6c292402fd83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197377.572306:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241152:0@lo:101: 00000100:00100000:0.0:1788197377.572362:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197377.572449:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb847a4d going to sleep for 11 seconds 00000100:00100000:2.0:1788197377.572487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241152 00000100:00100000:2.0:1788197377.572494:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241152 00000100:00100000:2.0:1788197377.572607:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197377.572615:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be45a0bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5822:x1875060776241152:12345-0@lo:101: 00010000:00010000:2.0:1788197377.572628:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197377.572642:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ef26d02/0x167e6c292402fd8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fd83 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.572664:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ef26d02/0x167e6c292402fd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fd83 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.572673:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ef26d02/0x167e6c292402fd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd83 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.572881:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ef26d02, rc 0) 00000100:00100000:2.0:1788197377.573035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be45a0bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5822:x1875060776241152:12345-0@lo:101: Request processed in 420us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197377.573042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788197377.573054:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241152:0@lo:101: 00010000:00010000:0.0:1788197377.573079:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000d4346f17/0x167e6c292402fd83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.573088:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000d4346f17/0x167e6c292402fd83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197377.573144:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241280:0@lo:501: 00000100:00100000:0.0:1788197377.573172:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197377.573232:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241280 00000100:00100000:1.0:1788197377.573238:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241280 00000100:00100000:0.0:1788197377.573244:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb847a4d going to sleep for 11 seconds 00000100:00100000:1.0:1788197377.573274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788197377.573280:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d71e2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5822:x1875060776241280:12345-0@lo:501: 00000100:00100000:1.0:1788197377.574035:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d71e2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5822:x1875060776241280:12345-0@lo:501: Request processed in 752us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197377.574044:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788197377.574263:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241280:0@lo:501: 00000100:00100000:0.0:1788197377.574307:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241408:0@lo:503: 00000100:00100000:0.0:1788197377.574347:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197377.574368:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb847a4d going to sleep for 11 seconds 00000100:00100000:2.0:1788197377.574595:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241408 00000100:00100000:2.0:1788197377.574601:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241408 00000100:00100000:2.0:1788197377.574639:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788197377.574646:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078d518e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5822:x1875060776241408:12345-0@lo:503: 00000100:00100000:3.0:1788197377.575443:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078d518e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5822:x1875060776241408:12345-0@lo:503: Request processed in 796us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197377.575451:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788197377.575597:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241408:0@lo:503: 00000100:00100000:3.0:1788197377.576586:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d6f7458 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5869:1875060776241536:0@lo:502: 00000100:00100000:3.0:1788197377.576641:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197377.576727:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241536 00000100:00100000:3.0:1788197377.576733:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 00000000608fc99e going to sleep for 11 seconds 00000100:00100000:1.0:1788197377.576734:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241536 00000100:00100000:1.0:1788197377.576784:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788197377.576792:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ad88dff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5869:x1875060776241536:12345-0@lo:502: 00000100:00100000:1.0:1788197377.577487:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ad88dff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5869:x1875060776241536:12345-0@lo:502: Request processed in 692us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197377.577497:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788197377.577613:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d6f7458 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5869:1875060776241536:0@lo:502: 00000020:01000004:3.0:1788197377.577672:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788197377.577686:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000016de915c) 00000020:00000080:3.0:1788197377.577704:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788197377.577803:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045f95d8e from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788197377.577807:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000045f95d8e from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788197377.577810:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000045f95d8e 4 00010000:00080000:3.0:1788197377.578194:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cd353f96@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:3.0:1788197377.580801:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788197377.581261:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788197377.581302:0:5869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788197377.581315:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x167e6c292402fd98 00000100:00080000:3.0:1788197377.581327:0:5869:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788197377.581332:0:5869:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cd353f96 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197377.581374:0:5869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001d6f7458 x1875060776241664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788197377.581401:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788197377.581693:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d6f7458 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776241664:0@lo:38: 00000100:00100000:1.0:1788197377.582152:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197377.582224:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241664 00000100:00100000:3.0:1788197377.582231:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241664 00000100:00100000:3.0:1788197377.582261:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197377.582266:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788197377.582267:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efe9e841 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875060776241664:12345-0@lo:38: 00000100:00100000:1.0:1788197377.582272:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788197377.582324:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efe9e841 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875060776241664:12345-0@lo:38: Request processed in 56us (172us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788197377.582331:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197377.582377:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788197377.582385:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000cd353f96 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788197377.582389:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788197377.582391:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d6f7458 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776241664:0@lo:38: 00000100:00100000:2.0:1788197377.582532:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cbbd96a pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5869:1875060776241792:0@lo:502: 00000100:00100000:2.0:1788197377.582574:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197377.582597:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 00000000551d74ff going to sleep for 11 seconds 00000100:00100000:3.0:1788197377.582692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241792 00000100:00100000:3.0:1788197377.582700:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241792 00000100:00100000:3.0:1788197377.582778:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788197377.582785:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008454d68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5869:x1875060776241792:12345-0@lo:502: 00000100:00100000:3.0:1788197377.583030:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008454d68c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5869:x1875060776241792:12345-0@lo:502: Request processed in 245us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197377.583037:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788197377.583112:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cbbd96a pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5869:1875060776241792:0@lo:502: 00000040:00080000:1.0:1788197377.583144:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788197377.584211:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788197377.584233:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788197377.584286:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 00000000d4346f17/0x167e6c292402fd83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.584299:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 00000000d4346f17/0x167e6c292402fd83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788197377.584347:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788197377.584349:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788197377.584351:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197377.584352:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197377.584353:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197377.584355:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197377.584356:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788197377.584357:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788197377.584358:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788197377.584359:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788197377.584361:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197377.584362:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788197377.584365:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788197377.584368:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788197377.584369:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788197377.584370:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197377.584371:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197377.584372:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197377.584373:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197377.584374:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788197377.584375:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788197377.584376:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788197377.584377:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788197377.584378:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197377.584378:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788197377.584399:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788197377.584413:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000297751e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241920:0@lo:253: 00000100:00100000:2.0:1788197377.584465:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197377.584513:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2c8ab07 going to sleep for 11 seconds 00000100:00100000:3.0:1788197377.587648:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776241920 00000100:00100000:3.0:1788197377.587661:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776241920 00000100:00100000:3.0:1788197377.587715:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788197377.587724:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e47ddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5822:x1875060776241920:12345-0@lo:253: 20000000:01000000:3.0:1788197377.587765:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788197377.587777:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788197377.635939:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788197377.635959:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788197377.636849:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788197377.636855:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788197377.636873:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.636890:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd67 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.636898:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.636947:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fd67 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.636961:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fd67 expref: 12 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197377.636975:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875060776242048:0@lo:104: 00000100:00100000:2.0:1788197377.637035:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197377.637096:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f011f087 going to sleep for 11 seconds 00000100:00100000:0.0:1788197377.637284:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242048 00000100:00100000:0.0:1788197377.637293:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242048 00000100:00100000:0.0:1788197377.637342:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788197377.637351:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf83b94c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5857:x1875060776242048:12345-0@lo:104: 00010000:00010000:0.0:1788197377.637361:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197377.637411:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788197377.637417:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf83b94c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5857:x1875060776242048:12345-0@lo:104: Request processed in 69us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.637424:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788197377.637557:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875060776242048:0@lo:104: 00010000:00010000:2.0:1788197377.637575:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.638987:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197377.638999:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.639009:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d16cc32f already unused, calling callback (00000000002de3cd) 10000000:00010000:3.0:1788197377.639030:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.639039:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197377.639045:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197377.639050:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197377.639096:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.639102:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197377.639118:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197377.639418:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b72764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776242176:0@lo:103: 00000100:00100000:1.0:1788197377.639477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197377.639656:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242176 00000100:00100000:2.0:1788197377.639664:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242176 00010000:00010000:2.0:1788197377.639691:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd67 expref: 13 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197377.639724:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788197377.639751:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f105aa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3312:x1875060776242176:12345-0@lo:103: 00010000:00010000:2.0:1788197377.639763:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197377.639768:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd67 expref: 13 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639779:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fd67 expref: 13 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639792:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ad38f41/0x167e6c292402fd6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fd67 expref: 13 pid: 5833 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639808:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639815:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788197377.639863:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003008759s 00010000:00010000:2.0:1788197377.639867:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639873:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639878:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639883:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639888:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008b0a7df1 already unused, calling callback (0000000086da6de3) 00010000:00010000:2.0:1788197377.639897:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639904:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639915:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.639925:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197377.639972:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f105aa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3312:x1875060776242176:12345-0@lo:103: Request processed in 235us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197377.639979:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788197377.640012:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.640020:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197377.640025:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008b0a7df1/0x167e6c292402fd9f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197377.640166:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b72764c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776242176:0@lo:103: 00010000:00010000:3.0:1788197377.640302:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: 00000000d16cc32f/0x167e6c292402fd67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197377.640316:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197377.640319:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197377.640321:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197377.651663:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197377.658457:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e47ddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5822:x1875060776241920:12345-0@lo:253: Request processed in 70727us (73984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197377.658472:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788197377.658656:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000297751e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5822:1875060776241920:0@lo:253: 10000000:01000000:2.0:1788197377.658675:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788197377.658688:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788197377.658691:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788197377.658693:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197377.658694:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197377.658695:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197377.658696:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197377.658698:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788197377.658712:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788197377.658714:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788197377.658715:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788197377.658717:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197377.658718:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788197377.658743:0:5822:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788197377.664760:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197377.665707:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788197377.665973:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197377.666340:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788197377.666761:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197377.667043:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788197377.671482:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197377.671776:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788197377.672301:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197377.672505:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788197377.672938:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197377.673119:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788197377.723168:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788197377.760616:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788197377.760924:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788197377.760928:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788197377.761002:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788197377.770913:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788197377.772019:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788197377.773458:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788197377.773477:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788197377.773947:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197377.776453:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788197377.777299:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788197377.777337:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788197377.777783:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788197377.778039:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788197377.779863:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788197377.780001:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788197377.780426:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788197377.780595:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788197377.781077:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788197377.781365:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788197377.781537:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788197377.781816:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788197377.782032:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788197377.782306:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788197377.782448:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788197377.782800:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788197377.783028:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788197377.783373:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788197377.783545:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788197377.783718:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788197377.784103:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788197377.784787:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788197377.785115:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788197377.785403:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788197377.785700:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788197377.786036:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788197377.786335:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788197377.786474:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788197377.786647:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788197377.786795:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788197377.786982:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788197377.787156:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788197377.788283:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788197377.788436:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788197377.788701:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788197377.789113:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788197377.789415:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788197377.811468:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788197377.880121:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788197377.880169:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f0101d93988 00100000:10000000:2.0:1788197377.880180:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788197377.883981:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788197377.884022:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788197377.884048:0:5822:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788197377.884083:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788197377.941931:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788197377.942288:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788197377.942293:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788197378.671973:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197379.694363:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197380.719132:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197381.741958:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197382.767087:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788197383.025777:0:474:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788197383.025787:0:474:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788197383.025789:0:474:0:(import.c:65:import_set_state_nolock()) 00000000cd353f96 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788197383.025800:0:474:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000cd353f96 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1788197383.025819:0:474:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a812c3e x1875060776242432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788197383.025875:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776242432:0@lo:38: 00000100:00100000:2.0:1788197383.025952:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197383.027396:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000297751e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776242304:0@lo:400: 00000100:00100000:2.0:1788197383.027402:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242432 00000100:00100000:0.0:1788197383.027464:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197383.027521:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242304 00000100:00100000:0.0:1788197383.027529:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242304 00000100:00100000:0.0:1788197383.027572:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788197383.027583:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3f7660b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:3313:x1875060776242304:12345-0@lo:400: 00000100:00100000:0.0:1788197383.027640:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3f7660b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:3313:x1875060776242304:12345-0@lo:400: Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197383.027648:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788197383.027695:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000297751e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776242304:0@lo:400: 00000100:00100000:2.0:1788197383.028269:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242432 00000100:00100000:2.0:1788197383.029028:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197383.029036:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a99aff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875060776242432:12345-0@lo:38: 00010000:00080000:2.0:1788197383.029060:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:2.0:1788197383.029388:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x167e6c292402fda6 00000004:00100000:2.0:1788197383.029499:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788197383.029635:0:5843:0:(import.c:65:import_set_state_nolock()) 00000000185b58cd : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788197383.029734:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a99aff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875060776242432:12345-0@lo:38: Request processed in 697us (3781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197383.029743:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788197383.032425:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008a812c3e x1875060776242432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788197393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788197383.032453:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788197383.032464:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788197383.032469:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788197383.032472:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000cd353f96 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788197383.032479:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776242432:0@lo:38: 00000001:02000400:2.0:1788197383.128630:0:6120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788197383.793798:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788197384.045934:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788197384.045943:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c706bce800 from 3 10000000:01000000:1.0:1788197384.045948:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788197384.045998:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 000000007c9e432d/0x167e6c292402fdad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197384.046010:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 000000007c9e432d/0x167e6c292402fdad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197384.046020:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 000000007c9e432d/0x167e6c292402fdad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197384.046040:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0f81a56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776242560:0@lo:101: 00000100:00100000:1.0:1788197384.046110:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197384.046166:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c0319f2 going to sleep for 11 seconds 00000100:00100000:0.0:1788197384.046321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242560 00000100:00100000:0.0:1788197384.046329:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242560 00000100:00100000:0.0:1788197384.046378:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788197384.046386:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007300cbdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5839:x1875060776242560:12345-0@lo:101: 00010000:00010000:0.0:1788197384.046412:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197384.046425:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a34f275/0x167e6c292402fdb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fdad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197384.046445:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a34f275/0x167e6c292402fdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fdad expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197384.046453:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a34f275/0x167e6c292402fdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fdad expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197384.046461:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a34f275, rc 0) 00000100:00100000:0.0:1788197384.046514:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007300cbdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776242560:12345-0@lo:101: Request processed in 129us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197384.046520:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788197384.046564:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0f81a56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776242560:0@lo:101: 00010000:00010000:0.0:1788197384.046577:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 000000007c9e432d/0x167e6c292402fdad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197384.046584:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 000000007c9e432d/0x167e6c292402fdad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197384.046631:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776242688:0@lo:256: 00000100:00100000:0.0:1788197384.046810:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197384.046848:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000195652f2 going to sleep for 11 seconds 00000100:00100000:0.0:1788197384.046863:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242688 00000100:00100000:0.0:1788197384.046866:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242688 00000100:00100000:0.0:1788197384.046887:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788197384.046892:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e46922fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776242688:12345-0@lo:256: 20000000:01000000:0.0:1788197384.047139:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788197384.047163:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788197384.047166:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788197384.047238:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e46922fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776242688:12345-0@lo:256: Request processed in 345us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197384.047246:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788197384.047278:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d05987f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776242688:0@lo:256: 10000000:01000000:0.0:1788197384.047317:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788197384.047323:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: 000000007c9e432d/0x167e6c292402fdad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197384.047330:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: 000000007c9e432d/0x167e6c292402fdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197384.819203:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197385.838767:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197386.882255:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197387.887119:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197388.145308:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c77623d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776242944:0@lo:400: 00000100:00100000:3.0:1788197388.145401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197388.145489:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242944 00000100:00100000:3.0:1788197388.145497:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242944 00000100:00100000:3.0:1788197388.145542:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788197388.145551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044fec58c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776242944:12345-0@lo:400: 00000100:00100000:3.0:1788197388.145614:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044fec58c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776242944:12345-0@lo:400: Request processed in 64us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197388.145622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788197388.145658:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002c77623d x1875060776242944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197388.145673:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c77623d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776242944:0@lo:400: 00000100:00100000:2.0:1788197388.145758:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788197388.145767:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001aa2735f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776242816:0@lo:400: 00000100:00100000:2.0:1788197388.145802:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197388.146856:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776242816 00000100:00100000:3.0:1788197388.146866:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776242816 00000100:00100000:3.0:1788197388.146916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788197388.146924:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c6e61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3313:x1875060776242816:12345-0@lo:400: 00000100:00100000:3.0:1788197388.146982:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c6e61e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3313:x1875060776242816:12345-0@lo:400: Request processed in 60us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197388.146989:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788197388.147422:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001aa2735f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776242816:0@lo:400: 00010000:00010000:0.0:1788197388.910124:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788197389.092088:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc5d881a0 20000000:00000080:1.0:1788197389.092114:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c737c33400 uarg=0000000000000000 20000000:01000000:1.0:1788197389.092147:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788197389.092153:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788197389.092157:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788197389.092431:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788197389.092441:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788197389.098320:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788197389.098619:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788197389.098689:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788197389.098743:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788197389.098761:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788197389.098783:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197389.098806:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd75 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197389.098813:0:6322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197389.099031:0:6322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fd75 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197389.099046:0:6322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fd75 expref: 11 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197389.099059:0:6322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001fba9a48 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875060776243072:0@lo:104: 00000100:00100000:1.0:1788197389.099131:0:6322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197389.099190:0:6322:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca7464a8 going to sleep for 11 seconds 00000100:00100000:2.0:1788197389.099550:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243072 00000100:00100000:2.0:1788197389.099558:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243072 00000100:00100000:2.0:1788197389.099616:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197389.099623:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e93318 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:6322:x1875060776243072:12345-0@lo:104: 00010000:00010000:2.0:1788197389.099637:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.099733:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197389.099738:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e93318 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:6322:x1875060776243072:12345-0@lo:104: Request processed in 115us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197389.099744:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788197389.099766:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197389.099772:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.099779:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000106438c3 already unused, calling callback (00000000002de3cd) 10000000:00010000:2.0:1788197389.099782:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.099791:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197389.099797:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197389.099803:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788197389.099861:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.099867:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788197389.100121:0:6322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001fba9a48 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875060776243072:0@lo:104: 00010000:00010000:3.0:1788197389.100140:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100257:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100264:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: 00000000106438c3/0x167e6c292402fd75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100300:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197389.100302:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197389.100304:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197389.100311:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197389.100327:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776243200:0@lo:103: 00000100:00100000:2.0:1788197389.100359:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197389.100393:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243200 00000100:00100000:2.0:1788197389.100397:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243200 00010000:00010000:2.0:1788197389.100412:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd75 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197389.100433:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197389.100438:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fbf0bf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3311:x1875060776243200:12345-0@lo:103: 00010000:00010000:2.0:1788197389.100448:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197389.100452:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd75 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100461:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fd75 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100472:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a298ba88/0x167e6c292402fd7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fd75 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100485:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100491:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100512:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100718:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100725:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100730:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100735:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a79198eb already unused, calling callback (0000000086da6de3) 00010000:00010000:2.0:1788197389.100738:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100744:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100759:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197389.100768:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197389.100794:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fbf0bf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:3311:x1875060776243200:12345-0@lo:103: Request processed in 356us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197389.100800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197389.100842:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776243200:0@lo:103: 00010000:00010000:3.0:1788197389.100902:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197389.100909:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197389.100913:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a79198eb/0x167e6c292402fdbb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197389.259018:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788197389.259027:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c706bce800 from 1 10000000:01000000:1.0:1788197389.259032:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788197389.259080:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: 00000000197b5e61/0x167e6c292402fdc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197389.259091:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: 00000000197b5e61/0x167e6c292402fdc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197389.259101:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: 00000000197b5e61/0x167e6c292402fdc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197389.259121:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0048893 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776243328:0@lo:101: 00000100:00100000:1.0:1788197389.259183:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197389.259233:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e580d48 going to sleep for 11 seconds 00000100:00100000:0.0:1788197389.259690:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243328 00000100:00100000:0.0:1788197389.259698:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243328 00000100:00100000:0.0:1788197389.259754:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788197389.259763:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d2bbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:5839:x1875060776243328:12345-0@lo:101: 00010000:00010000:0.0:1788197389.259778:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197389.259792:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ece7da6a/0x167e6c292402fdc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fdc2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197389.259813:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ece7da6a/0x167e6c292402fdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197389.259992:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ece7da6a/0x167e6c292402fdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197389.260012:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ece7da6a, rc 0) 00000100:00100000:0.0:1788197389.260062:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d2bbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776243328:12345-0@lo:101: Request processed in 299us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197389.260068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788197389.260191:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0048893 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776243328:0@lo:101: 00010000:00010000:3.0:1788197389.260206:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: 00000000197b5e61/0x167e6c292402fdc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197389.260215:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: 00000000197b5e61/0x167e6c292402fdc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197389.260268:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c77623d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776243456:0@lo:501: 00000100:00100000:3.0:1788197389.260296:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197389.260320:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c347b60 going to sleep for 11 seconds 00000100:00100000:3.0:1788197389.260333:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243456 00000100:00100000:3.0:1788197389.260336:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243456 00000100:00100000:3.0:1788197389.260361:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788197389.260367:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057aaeb0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776243456:12345-0@lo:501: 00000100:00100000:3.0:1788197389.260623:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057aaeb0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776243456:12345-0@lo:501: Request processed in 256us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197389.260641:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788197389.260686:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c77623d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776243456:0@lo:501: 00000100:00100000:3.0:1788197389.260711:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c77623d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776243584:0@lo:503: 00000100:00100000:3.0:1788197389.260748:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197389.260762:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c347b60 going to sleep for 11 seconds 00000100:00100000:3.0:1788197389.260773:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243584 00000100:00100000:3.0:1788197389.260776:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243584 00000100:00100000:3.0:1788197389.260796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788197389.260802:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087931a59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776243584:12345-0@lo:503: 00000100:00100000:3.0:1788197389.260944:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087931a59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776243584:12345-0@lo:503: Request processed in 141us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197389.260950:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788197389.260983:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c77623d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776243584:0@lo:503: 00000100:00100000:2.0:1788197389.268052:0:6332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6332:1875060776243712:0@lo:502: 00000100:00100000:2.0:1788197389.268131:0:6332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197389.268190:0:6332:0:(client.c:2715:ptlrpc_set_wait()) set 00000000591becd0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197389.269964:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243712 00000100:00100000:3.0:1788197389.269976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243712 00000100:00100000:3.0:1788197389.270079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788197389.270089:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000699d0a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6332:x1875060776243712:12345-0@lo:502: 00000100:00100000:3.0:1788197389.270376:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000699d0a66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6332:x1875060776243712:12345-0@lo:502: Request processed in 287us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197389.270386:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788197389.270486:0:6332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a812c3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6332:1875060776243712:0@lo:502: 00000020:01000000:0.0:1788197389.270537:0:6332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788197389.270547:0:6332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197389.270558:0:6332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788197389.270566:0:6332:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c706bce800 00000020:00000080:0.0:1788197389.270569:0:6332:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788197389.270632:0:6332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6332:1875060776243840:0@lo:502: 00000100:00100000:0.0:1788197389.270690:0:6332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197389.279079:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243840 00000100:00100000:2.0:1788197389.279092:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243840 00000100:00100000:2.0:1788197389.279141:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788197389.279151:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6332:x1875060776243840:12345-0@lo:502: 00000100:00100000:2.0:1788197389.279383:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6332:x1875060776243840:12345-0@lo:502: Request processed in 232us (8692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197389.279390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788197389.280170:0:6332:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707cea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197389.280201:0:6332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c00e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6332:1875060776243840:0@lo:502: 00000020:01000000:0.0:1788197389.280236:0:6332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197389.280244:0:6332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197389.280246:0:6332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788197389.280250:0:6332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788197389.280313:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788197389.280330:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197389.280340:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197389.280350:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197389.938764:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197390.960383:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197391.982097:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197393.013024:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197393.266248:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776244096:0@lo:400: 00000100:00100000:0.0:1788197393.266313:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197393.266371:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788197393.266378:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776243968:0@lo:400: 00000100:00100000:0.0:1788197393.266406:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197393.266451:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244096 00000100:00100000:0.0:1788197393.266457:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244096 00000100:00100000:0.0:1788197393.266508:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197393.266517:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776244096:12345-0@lo:400: 00000100:00100000:0.0:1788197393.266567:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776244096:12345-0@lo:400: Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197393.266574:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197393.266596:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776243968 00000100:00100000:0.0:1788197393.266601:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776243968 00000100:00100000:0.0:1788197393.266632:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788197393.266639:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3314:x1875060776243968:12345-0@lo:400: 00000100:00100000:0.0:1788197393.266680:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3314:x1875060776243968:12345-0@lo:400: Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197393.266686:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788197393.266724:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776243968:0@lo:400: 00010000:00080000:0.0:1788197393.266738:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c707c03b80 x1875060776244096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197393.266749:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776244096:0@lo:400: 00010000:00010000:0.0:1788197394.031701:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197395.054004:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197396.078869:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788197396.409771:0:6694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788197396.409777:0:6694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788197396.414319:0:6694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c70f634000 00000020:01000004:2.0:1788197396.414359:0:6694:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788197396.414376:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788197396.419185:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93c73cff3370) 00000020:00000080:2.0:1788197396.419228:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788197396.470974:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788197396.471395:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788197396.494945:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788197396.500671:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788197396.500705:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788197396.500763:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788197396.500789:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788197396.501219:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788197396.501229:0:6694:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788197396.501306:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x167e6c292402fdd7 00000020:01000004:1.0:1788197396.501314:0:6694:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788197396.501334:0:6694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788197396.501338:0:6694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788197396.501343:0:6694:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788197396.501348:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788197396.501359:0:6694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93c73cfb99b8) 00000020:00000080:1.0:1788197396.501369:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788197396.502732:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788197396.502921:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788197396.502933:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788197396.508183:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788197396.508200:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788197396.509039:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788197396.509050:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788197396.510712:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788197396.510945:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788197396.510951:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788197396.511927:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788197396.511934:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788197396.568057:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197396.568549:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788197396.568558:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788197396.592892:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788197396.592920:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788197396.601930:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788197396.601960:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788197396.623206:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788197396.624389:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788197396.624396:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788197396.632760:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788197396.632779:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788197396.709118:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197396.710807:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788197396.710817:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788197396.719073:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788197396.719095:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788197396.719887:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788197396.719925:0:6694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788197396.719947:0:6694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788197396.778200:0:6694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788197396.778243:0:6694:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788197396.778248:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788197396.778250:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788197396.778252:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197396.778253:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197396.778254:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197396.778255:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197396.778257:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788197396.778259:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788197396.778261:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788197396.778262:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197396.778269:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788197396.778274:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788197396.778276:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788197396.778277:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788197396.778278:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197396.778279:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197396.778280:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197396.778280:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197396.778281:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788197396.778282:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788197396.778692:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788197396.778695:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197396.778696:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788197396.778807:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788197396.779606:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776244224:0@lo:253: 00000100:00100000:2.0:1788197396.780954:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197396.781090:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056c0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788197396.781590:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244224 00000100:00100000:1.0:1788197396.781601:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244224 00000100:00100000:1.0:1788197396.781695:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788197396.781706:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776244224:12345-0@lo:253: 20000000:01000000:1.0:1788197396.781799:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788197396.781803:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788197396.781809:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788197396.781812:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788197396.783664:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788197396.784511:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788197396.784534:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788197396.784589:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788197396.784599:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788197396.784648:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788197396.784701:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788197396.785624:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788197396.785659:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:1.0:1788197396.785662:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:1.0:1788197396.785698:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788197396.785706:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788197396.787059:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788197396.787077:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:1.0:1788197396.787129:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788197396.787139:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788197396.787172:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788197396.787241:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788197396.788884:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788197396.788914:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:0.0:1788197396.788916:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:0.0:1788197396.788956:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788197396.788964:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788197396.789016:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788197396.789025:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:0.0:1788197396.789076:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788197396.789086:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788197396.789120:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788197396.789153:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788197396.789170:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788197396.789173:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788197396.789176:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788197396.790264:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788197396.790269:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788197396.790382:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788197396.790385:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788197396.791240:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788197396.791412:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788197396.791468:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788197396.792049:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788197396.792094:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788197396.792222:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788197396.792235:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788197396.792237:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788197396.792908:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788197396.792958:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788197396.793004:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788197396.793409:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788197396.793454:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788197396.793490:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788197396.793501:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788197396.793504:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788197396.794047:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788197396.794448:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788197396.794489:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788197396.794577:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788197396.794593:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788197396.794602:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788197396.794611:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788197396.794628:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.794659:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742143a00/0x167e6c292402fcfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.794666:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700031000/0x167e6c292402fd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd13 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.794673:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742142800/0x167e6c292402fd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fd83 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.794681:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.794790:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742142800/0x167e6c292402fd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fd83 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.794806:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c742142800/0x167e6c292402fd8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fd83 expref: 12 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197396.794850:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875060776244352:0@lo:104: 00000100:00100000:0.0:1788197396.794911:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788197396.795026:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700031000/0x167e6c292402fd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fd13 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.795034:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700031000/0x167e6c292402fd1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fd13 expref: 12 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197396.795042:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c00700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875060776244480:0@lo:104: 00000100:00100000:0.0:1788197396.795071:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788197396.795317:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742143a00/0x167e6c292402fcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.795326:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c742143a00/0x167e6c292402fcfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 12 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197396.795335:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875060776244608:0@lo:104: 00000100:00100000:0.0:1788197396.795357:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.795483:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244352 00000100:00100000:1.0:1788197396.795490:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244352 00000100:00100000:1.0:1788197396.795528:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244480 00000100:00100000:1.0:1788197396.795530:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244480 00000100:00100000:1.0:1788197396.795545:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197396.795553:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:5833:x1875060776244352:12345-0@lo:104: 00010000:00010000:1.0:1788197396.795565:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795630:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788197396.795646:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:5833:x1875060776244352:12345-0@lo:104: Request processed in 94us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.795652:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197396.795670:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197396.795676:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5833:x1875060776244480:12345-0@lo:104: 00010000:00010000:1.0:1788197396.795683:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795730:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788197396.795735:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5833:x1875060776244480:12345-0@lo:104: Request processed in 60us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.795741:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788197396.795761:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788197396.795775:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795782:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031800 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:1.0:1788197396.795786:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795795:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788197396.795802:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197396.795808:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788197396.795873:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795881:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788197396.795905:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795911:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c292402fd83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795926:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197396.795930:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795935:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7420c3e00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:1.0:1788197396.795937:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795954:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788197396.795960:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197396.795965:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788197396.795979:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795985:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788197396.795991:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.795996:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7420c3e00/0x167e6c292402fd13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fd1a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.796009:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197396.796011:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197396.796013:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197396.796028:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776244736:0@lo:103: 00000100:00100000:1.0:1788197396.796057:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.796085:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197396.796091:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776244864:0@lo:103: 00000100:00100000:1.0:1788197396.796110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.796148:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244736 00000100:00100000:1.0:1788197396.796153:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244736 00010000:00010000:1.0:1788197396.796171:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742142800/0x167e6c292402fd8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd83 expref: 13 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197396.796204:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244864 00000100:00100000:1.0:1788197396.796208:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244864 00010000:00010000:1.0:1788197396.796237:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700031000/0x167e6c292402fd1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd13 expref: 14 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197396.796251:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197396.796258:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3311:x1875060776244736:12345-0@lo:103: 00010000:00010000:1.0:1788197396.796267:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197396.796273:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742142800/0x167e6c292402fd8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd83 expref: 14 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.796444:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742142800/0x167e6c292402fd8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fd83 expref: 14 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.796465:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197396.796500:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3311:x1875060776244736:12345-0@lo:103: Request processed in 242us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.796507:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197396.796524:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197396.796530:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3311:x1875060776244864:12345-0@lo:103: 00010000:00010000:1.0:1788197396.796539:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197396.796544:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700031000/0x167e6c292402fd1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fd13 expref: 13 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.796552:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700031000/0x167e6c292402fd1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fd13 expref: 13 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.796561:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197396.796588:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3311:x1875060776244864:12345-0@lo:103: Request processed in 58us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.796593:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197396.796650:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776244864:0@lo:103: 00000100:00100000:1.0:1788197396.796659:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776244736:0@lo:103: 00010000:00010000:3.0:1788197396.796759:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197396.797000:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788197396.797018:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142800/0x167e6c292402fd8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fd83 expref: 12 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197396.797374:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244608 00000100:00100000:1.0:1788197396.797381:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244608 00000100:00100000:1.0:1788197396.797417:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788197396.797425:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5833:x1875060776244608:12345-0@lo:104: 00010000:00010000:1.0:1788197396.797438:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.797504:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788197396.797510:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5833:x1875060776244608:12345-0@lo:104: Request processed in 86us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.797516:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788197396.797562:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197396.797569:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.797577:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7420c2a00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197396.797581:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.797590:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197396.797598:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197396.797603:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197396.797668:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.797676:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197396.797705:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.797712:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7420c2a00/0x167e6c292402fcf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fcfe expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.797743:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197396.797745:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197396.797747:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197396.797762:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776244992:0@lo:103: 00000100:00100000:3.0:1788197396.797807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197396.797902:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776244992 00000100:00100000:3.0:1788197396.797906:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776244992 00010000:00010000:3.0:1788197396.797925:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742143a00/0x167e6c292402fcfe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 13 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197396.797947:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197396.797954:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3313:x1875060776244992:12345-0@lo:103: 00010000:00010000:3.0:1788197396.797964:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197396.797969:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742143a00/0x167e6c292402fcfe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 13 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.797978:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742143a00/0x167e6c292402fcfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 13 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.797995:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798008:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798024:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798031:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798037:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798043:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798048:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197396.798052:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798058:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798066:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.798075:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197396.798103:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3313:x1875060776244992:12345-0@lo:103: Request processed in 149us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197396.798109:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197396.798142:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776244992:0@lo:103: 00000100:00100000:0.0:1788197396.798493:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875060776244352:0@lo:104: 00010000:00010000:0.0:1788197396.798519:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700031000/0x167e6c292402fd1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fd13 expref: 11 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197396.798529:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c00700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875060776244480:0@lo:104: 00010000:00010000:0.0:1788197396.798540:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143a00/0x167e6c292402fcfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fcf7 expref: 10 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197396.798550:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5833:1875060776244608:0@lo:104: 00010000:00010000:0.0:1788197396.798569:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.798577:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.798583:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.798596:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030800/0x167e6c292402fde5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788197396.798610:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788197396.863239:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:6694:x1875060776244224:12345-0@lo:253: Request processed in 81525us (82283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197396.863254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788197396.863358:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776244224:0@lo:253: 10000000:01000000:3.0:1788197396.863374:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788197396.863378:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788197396.863379:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788197396.863381:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197396.863382:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788197396.863383:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197396.863384:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197396.863385:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788197396.863387:0:6694:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788197396.863389:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197396.863390:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788197396.863410:0:6694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c70f634000 from lustre-OST0000 10000000:01000000:3.0:1788197396.863445:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788197396.863448:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788197396.863455:0:6694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c70623b370 local copy 10000000:01000000:3.0:1788197396.863459:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788197396.863492:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.863504:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.863514:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197396.863533:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245120:0@lo:101: 00000100:00100000:3.0:1788197396.863570:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197396.863746:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7060ea300 going to sleep for 11 seconds 00000100:00100000:1.0:1788197396.863971:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776245120 00000100:00100000:1.0:1788197396.863979:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776245120 00000100:00100000:1.0:1788197396.864057:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788197396.864068:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:6694:x1875060776245120:12345-0@lo:101: 00010000:00010000:1.0:1788197396.864079:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197396.864092:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701386000/0x167e6c292402fdf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fdec expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.864114:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701386000/0x167e6c292402fdf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fdec expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.864125:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701386000/0x167e6c292402fdf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fdec expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.864145:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386000, rc 0) 00000100:00100000:1.0:1788197396.864189:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:6694:x1875060776245120:12345-0@lo:101: Request processed in 123us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.864195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788197396.864309:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245120:0@lo:101: 00010000:00010000:3.0:1788197396.864322:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.864337:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197396.864437:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245248:0@lo:501: 00000100:00100000:3.0:1788197396.864477:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197396.864644:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7060ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1788197396.864860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776245248 00000100:00100000:0.0:1788197396.864866:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776245248 00000100:00100000:0.0:1788197396.864892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788197396.864898:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:6694:x1875060776245248:12345-0@lo:501: 00000100:00100000:0.0:1788197396.865116:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:6694:x1875060776245248:12345-0@lo:501: Request processed in 217us (638us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788197396.865123:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788197396.865211:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245248:0@lo:501: 10000000:01000000:3.0:1788197396.865227:0:6694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788197396.865257:0:6694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788197396.865263:0:6694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.865271:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.865278:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.865385:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788197396.865408:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c70f634000 10000000:01000000:3.0:1788197396.865482:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788197396.865489:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93c70623b370 10000000:01000000:3.0:1788197396.865493:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788197396.865497:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93c70623b370 from 1 10000000:01000000:3.0:1788197396.865499:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788197396.865522:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.865540:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.865548:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197396.865564:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245376:0@lo:101: 00000100:00100000:3.0:1788197396.865603:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197396.865645:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c721c8c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788197396.865813:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776245376 00000100:00100000:1.0:1788197396.865819:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776245376 00000100:00100000:1.0:1788197396.865870:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788197396.865878:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+10:6694:x1875060776245376:12345-0@lo:101: 00010000:00010000:1.0:1788197396.865886:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197396.865898:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701386e00/0x167e6c292402fe01 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fdfa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.865917:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701386e00/0x167e6c292402fe01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fdfa expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.865925:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701386e00/0x167e6c292402fe01 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fdfa expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.865932:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386e00, rc 0) 00000100:00100000:1.0:1788197396.865964:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:6694:x1875060776245376:12345-0@lo:101: Request processed in 87us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.865970:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788197396.866104:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245376:0@lo:101: 00010000:00010000:3.0:1788197396.866117:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.866125:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fe01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197396.866139:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788197396.866155:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.866163:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197396.866169:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788197396.866174:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788197396.866177:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788197396.866180:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788197396.866193:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.866207:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.866215:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197396.866228:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245504:0@lo:101: 00000100:00100000:3.0:1788197396.866253:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197396.866282:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c721c8c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788197396.866374:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776245504 00000100:00100000:2.0:1788197396.866379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776245504 00000100:00100000:2.0:1788197396.866411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788197396.866488:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:6694:x1875060776245504:12345-0@lo:101: 00010000:00010000:2.0:1788197396.866496:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197396.866505:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fe08 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197396.866520:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fe08 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197396.866528:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe08 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197396.866534:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142200, rc 0) 00000100:00100000:2.0:1788197396.866576:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776245504:12345-0@lo:101: Request processed in 90us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197396.866588:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788197396.866747:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245504:0@lo:101: 00010000:00010000:1.0:1788197396.866758:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.866765:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197396.866895:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245632:0@lo:501: 00000100:00100000:1.0:1788197396.866927:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.866947:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737182840 going to sleep for 11 seconds 00000100:00100000:2.0:1788197396.867076:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776245632 00000100:00100000:2.0:1788197396.867081:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776245632 00000100:00100000:2.0:1788197396.867114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788197396.867122:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776245632:12345-0@lo:501: 00000100:00100000:2.0:1788197396.867335:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776245632:12345-0@lo:501: Request processed in 214us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197396.867342:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788197396.867491:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245632:0@lo:501: 00000100:00100000:1.0:1788197396.867518:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245760:0@lo:503: 00000100:00100000:1.0:1788197396.867557:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.867579:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737182840 going to sleep for 11 seconds 00000100:00100000:2.0:1788197396.867696:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776245760 00000100:00100000:2.0:1788197396.867700:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776245760 00000100:00100000:2.0:1788197396.867732:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788197396.867739:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776245760:12345-0@lo:503: 00000100:00100000:2.0:1788197396.867903:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776245760:12345-0@lo:503: Request processed in 163us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197396.867910:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788197396.868059:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245760:0@lo:503: 00000040:00080000:1.0:1788197396.868316:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788197396.868371:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245888:0@lo:502: 00000100:00100000:1.0:1788197396.868409:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.868552:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737182840 going to sleep for 11 seconds 00010000:00010000:0.0:1788197396.868629:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197396.868648:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.868656:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6a00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:0.0:1788197396.868660:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.868668:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788197396.868674:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197396.868690:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788197396.868852:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.868859:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788197396.868879:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.868887:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c292402fdec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x167e6c292402fdf3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.868902:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197396.868904:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197396.868906:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197396.868914:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197396.868927:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776246016:0@lo:103: 00000100:00100000:0.0:1788197396.868959:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.869041:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246016 00000100:00100000:1.0:1788197396.869047:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246016 00000100:00100000:1.0:1788197396.869095:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197396.869103:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3313:x1875060776246016:12345-0@lo:103: 00010000:00010000:1.0:1788197396.869113:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197396.869128:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701386000/0x167e6c292402fdf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292402fdec expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197396.869140:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197396.869172:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:3313:x1875060776246016:12345-0@lo:103: Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.869179:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197396.869207:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776246016:0@lo:103: 00000100:00100000:3.0:1788197396.869339:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776245888 00000100:00100000:3.0:1788197396.869344:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776245888 00000100:00100000:3.0:1788197396.869373:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788197396.869380:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:6694:x1875060776245888:12345-0@lo:502: 00000100:00100000:1.0:1788197396.869965:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776245888:0@lo:502: 00000040:00080000:1.0:1788197396.870257:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788197396.870311:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788197396.870348:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788197396.870399:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788197396.870517:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788197396.870557:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788197396.870589:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246144:0@lo:502: 00000100:00100000:1.0:1788197396.870658:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.870699:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737182840 going to sleep for 11 seconds 00000100:00100000:0.0:1788197396.870812:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246144 00000100:00100000:0.0:1788197396.870818:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246144 00000100:00100000:0.0:1788197396.870869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788197396.870876:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246144:12345-0@lo:502: 00000100:00100000:0.0:1788197396.871041:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246144:12345-0@lo:502: Request processed in 164us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197396.871048:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788197396.871147:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246144:0@lo:502: 00000040:00080000:1.0:1788197396.871233:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788197396.871243:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:3.0:1788197396.873131:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:6694:x1875060776245888:12345-0@lo:502: Request processed in 333us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197396.873152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:01000000:1.0:1788197396.873571:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788197396.873580:0:6712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788197396.873586:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197396.873589:0:6712:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788197396.873594:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788197396.873607:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93c73cfbcd28) 00000020:00000080:1.0:1788197396.873628:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788197396.873644:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788197396.873797:0:6712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c70f634000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788197396.873805:0:6712:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788197396.873813:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x167e6c292402fe1d 00010000:00010000:1.0:1788197396.886974:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788197396.887316:0:6712:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788197396.891380:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788197396.894546:0:6712:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788197396.904514:0:6712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788197396.906130:0:6712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788197396.908275:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788197396.908288:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197396.908295:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197396.908297:0:6712:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788197396.908300:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197396.908303:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197396.908305:0:6712:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788197396.908308:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788197396.908309:0:6712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788197396.908365:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197396.908368:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197396.908370:0:6712:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788197396.908374:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788197396.908871:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788197396.908895:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788197396.908912:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.908935:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197396.908942:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c70f634000 from 1 10000000:01000000:0.0:1788197396.908945:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197396.908978:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.908986:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.908997:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197396.909017:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246272:0@lo:101: 00000100:00100000:0.0:1788197396.909080:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197396.909307:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197396.909333:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246272 00000100:00100000:0.0:1788197396.909341:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246272 00000100:00100000:0.0:1788197396.909538:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788197396.909549:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:6694:x1875060776246272:12345-0@lo:101: 00010000:00010000:0.0:1788197396.909563:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197396.909575:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fe24 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.909608:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fe24 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.909619:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe24 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.909653:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031000, rc 0) 00000100:00100000:0.0:1788197396.909697:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246272:12345-0@lo:101: Request processed in 149us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197396.909703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788197396.911639:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246272:0@lo:101: 00010000:00010000:2.0:1788197396.911666:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197396.911677:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197396.911797:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246400:0@lo:501: 00000100:00100000:2.0:1788197396.911868:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197396.916239:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056c00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197396.919219:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246400 00000100:00100000:3.0:1788197396.919233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246400 00000100:00100000:3.0:1788197396.919288:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788197396.919299:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246400:12345-0@lo:501: 00000100:00100000:3.0:1788197396.919733:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246400:12345-0@lo:501: Request processed in 435us (7863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197396.919741:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788197396.920817:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246400:0@lo:501: 00000100:00100000:3.0:1788197396.921362:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246528:0@lo:503: 00000100:00100000:3.0:1788197396.922038:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197396.922097:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c721c8c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788197396.922131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246528 00000100:00100000:3.0:1788197396.922140:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246528 00000100:00100000:3.0:1788197396.922195:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788197396.922744:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246528:12345-0@lo:503: 00000100:00100000:3.0:1788197396.923502:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246528:12345-0@lo:503: Request processed in 1295us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197396.923512:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788197396.923592:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246528:0@lo:503: 00000040:00080000:3.0:1788197396.924506:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788197396.924656:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246656:0@lo:502: 00000100:00100000:3.0:1788197396.924721:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197396.924764:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7091019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197396.924926:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246656 00000100:00100000:2.0:1788197396.924942:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246656 00000100:00100000:2.0:1788197396.924993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788197396.925002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246656:12345-0@lo:502: 00000100:00100000:2.0:1788197396.925238:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246656:12345-0@lo:502: Request processed in 236us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197396.925247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788197396.925255:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246656:0@lo:502: 00000040:00080000:3.0:1788197396.925675:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788197396.925727:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788197396.925762:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246784:0@lo:502: 00000100:00100000:3.0:1788197396.925799:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197396.925869:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246784 00000100:00100000:0.0:1788197396.925875:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246784 00000100:00100000:0.0:1788197396.926020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788197396.926029:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246784:12345-0@lo:502: 00000100:00100000:0.0:1788197396.926180:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246784:12345-0@lo:502: Request processed in 152us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197396.926188:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788197396.926294:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7091019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197396.926316:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246784:0@lo:502: 00000040:00080000:3.0:1788197396.926503:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788197396.926516:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788197396.936623:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197396.936648:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197396.936650:0:6716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788197396.936657:0:6716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c70f634000 00000020:00000080:3.0:1788197396.936660:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788197396.936681:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197396.936685:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197396.936686:0:6716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788197396.936690:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788197396.937028:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788197396.937060:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197396.937080:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.937092:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197396.937136:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788197396.937139:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c70f634000 10000000:01000000:0.0:1788197396.937142:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c70f634000 10000000:01000000:0.0:1788197396.937147:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788197396.937152:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c70f634000 from 1 10000000:01000000:0.0:1788197396.937155:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788197396.937197:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.937225:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.937236:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197396.937448:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246912:0@lo:101: 00000100:00100000:1.0:1788197396.937520:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.937584:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737182f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197396.937774:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776246912 00000100:00100000:3.0:1788197396.937783:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776246912 00000100:00100000:3.0:1788197396.937863:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788197396.937874:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776246912:12345-0@lo:101: 00010000:00010000:3.0:1788197396.937888:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197396.937900:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fe32 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.937926:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fe32 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.938159:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe32 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197396.938169:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6000, rc 0) 00000100:00100000:3.0:1788197396.938234:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776246912:12345-0@lo:101: Request processed in 361us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197396.938241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788197396.938327:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776246912:0@lo:101: 00010000:00010000:2.0:1788197396.938353:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197396.938362:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197396.938464:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247040:0@lo:501: 00000100:00100000:2.0:1788197396.938493:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197396.938516:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056c0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788197396.938642:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247040 00000100:00100000:0.0:1788197396.938647:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247040 00000100:00100000:0.0:1788197396.938682:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788197396.938689:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247040:12345-0@lo:501: 00000100:00100000:0.0:1788197396.938946:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247040:12345-0@lo:501: Request processed in 256us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197396.938953:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788197396.939680:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247040:0@lo:501: 00000100:00100000:1.0:1788197396.939742:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247168:0@lo:503: 00000100:00100000:1.0:1788197396.939791:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.939841:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7371820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197396.940185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247168 00000100:00100000:3.0:1788197396.940192:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247168 00000100:00100000:0.0:1788197396.940270:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788197396.940282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247168:12345-0@lo:503: 00000100:00100000:0.0:1788197396.940483:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247168:12345-0@lo:503: Request processed in 204us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197396.940491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788197396.940708:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247168:0@lo:503: 00000040:00080000:1.0:1788197396.941165:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788197396.941231:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247296:0@lo:502: 00000100:00100000:1.0:1788197396.941277:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.941321:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7371820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197396.941432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247296 00000100:00100000:3.0:1788197396.941439:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247296 00000100:00100000:3.0:1788197396.941468:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788197396.941476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247296:12345-0@lo:502: 00000100:00100000:3.0:1788197396.941677:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247296:12345-0@lo:502: Request processed in 201us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197396.941684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788197396.942105:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247296:0@lo:502: 00000040:00080000:1.0:1788197396.942408:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788197396.943146:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788197396.943187:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788197396.943249:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788197396.943285:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788197396.943333:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788197396.943368:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788197396.943401:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788197396.944384:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788197396.945617:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788197396.945678:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788197396.945954:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788197396.945998:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788197396.946032:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788197396.946115:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788197396.946155:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788197396.946191:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788197396.946260:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788197396.946297:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788197396.946331:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788197396.946379:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788197396.946412:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788197396.947296:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788197396.947391:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788197396.947447:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788197396.947484:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788197396.947550:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788197396.947591:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788197396.948619:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247424:0@lo:502: 00000100:00100000:1.0:1788197396.948706:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197396.949067:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7371820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197396.949205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247424 00000100:00100000:3.0:1788197396.949213:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247424 00000100:00100000:3.0:1788197396.949373:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788197396.949382:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247424:12345-0@lo:502: 00000100:00100000:3.0:1788197396.949646:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247424:12345-0@lo:502: Request processed in 264us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197396.949654:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788197396.949697:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247424:0@lo:502: 00000040:00080000:2.0:1788197396.949800:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788197396.949816:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788197396.950507:0:6717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788197396.950521:0:6717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93c73c2fcd28) 00000020:00000080:3.0:1788197396.950540:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788197396.950613:0:6717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c70f634000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788197396.950617:0:6717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c70f634000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788197396.950620:0:6717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c70f634000 3 00010000:00080000:3.0:1788197396.950659:0:6717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c604c39000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.140@tcp at head 00010000:00010000:1.0:1788197396.955938:0:6717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788197396.956128:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788197396.956169:0:6717:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788197396.956182:0:6717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x167e6c292402fe47 00000100:00080000:1.0:1788197396.956193:0:6717:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788197396.956198:0:6717:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c604c39000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:1.0:1788197396.956254:0:6717:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c708389f80 x1875060776247552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788197396.956289:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875060776247552:0@lo:38: 00000100:00100000:1.0:1788197396.956351:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.956425:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247552 00000100:00100000:1.0:1788197396.956432:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247552 00000100:00100000:1.0:1788197396.956463:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197396.956470:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875060776247552:12345-0@lo:38: 00010000:00080000:1.0:1788197396.956499:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1788197396.956526:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x167e6c292402fe4e 00000004:00100000:1.0:1788197396.956540:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788197396.956567:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93c73f145000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197396.956615:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875060776247552:12345-0@lo:38: Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.956622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788197396.956673:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c708389f80 x1875060776247552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788197406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197396.956683:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788197396.956690:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788197396.956696:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788197396.956700:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788197396.956702:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c604c39000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788197396.956707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875060776247552:0@lo:38: 00000100:00080000:1.0:1788197396.956726:0:6717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788197396.956773:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776247680:0@lo:400: 00000100:00100000:1.0:1788197396.956797:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197396.956857:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247680 00000100:00100000:1.0:1788197396.956861:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247680 00000100:00100000:1.0:1788197396.956902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197396.956910:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776247680:12345-0@lo:400: 00000100:00100000:1.0:1788197396.956947:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776247680:12345-0@lo:400: Request processed in 38us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197396.956953:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788197396.956986:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c708389f80 x1875060776247680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197396.956997:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776247680:0@lo:400: 00000040:00080000:3.0:1788197396.967643:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788197396.967908:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788197396.967935:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788197396.967958:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197396.967969:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788197396.968026:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788197396.968028:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788197396.968030:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197396.968031:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197396.968033:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197396.968034:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197396.968036:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197396.968038:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788197396.968039:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788197396.968040:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197396.968042:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788197396.968046:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788197396.968048:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788197396.968050:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788197396.968051:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197396.968052:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197396.968053:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197396.968054:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197396.968055:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197396.968056:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788197396.968057:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788197396.968058:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197396.968059:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788197396.968083:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788197396.968100:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247808:0@lo:253: 00000100:00100000:0.0:1788197396.968162:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197396.968202:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788197396.970973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247808 00000100:00100000:0.0:1788197396.970987:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247808 00000100:00100000:0.0:1788197396.971684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788197396.971699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:6694:x1875060776247808:12345-0@lo:253: 20000000:01000000:0.0:1788197396.971800:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788197396.971817:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788197397.018651:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788197397.018674:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788197397.018850:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788197397.018855:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788197397.018887:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.018904:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030a00/0x167e6c292402fdb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fdad expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.018911:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.018947:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030a00/0x167e6c292402fdb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fdad expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.018961:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700030a00/0x167e6c292402fdb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fdad expref: 13 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197397.018976:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875060776247936:0@lo:104: 00000100:00100000:3.0:1788197397.019038:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197397.019094:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056ec000 going to sleep for 11 seconds 00000100:00100000:1.0:1788197397.020039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776247936 00000100:00100000:1.0:1788197397.020050:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776247936 00000100:00100000:1.0:1788197397.020094:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788197397.020103:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5857:x1875060776247936:12345-0@lo:104: 00010000:00010000:1.0:1788197397.020117:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197397.020183:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788197397.020189:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5857:x1875060776247936:12345-0@lo:104: Request processed in 88us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197397.020196:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788197397.020379:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197397.020385:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.020392:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386400 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197397.020396:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.020404:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197397.020410:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197397.020495:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197397.020532:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.020538:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197397.020564:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.020572:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402fdad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fdb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.020588:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197397.020590:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197397.020592:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197397.020600:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197397.020613:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776248064:0@lo:103: 00000100:00100000:3.0:1788197397.020662:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197397.020703:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248064 00000100:00100000:3.0:1788197397.020707:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248064 00010000:00010000:3.0:1788197397.020728:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030a00/0x167e6c292402fdb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fdad expref: 14 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197397.022030:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788197397.022043:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7066c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3311:x1875060776248064:12345-0@lo:103: 00010000:00010000:3.0:1788197397.022059:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197397.022065:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030a00/0x167e6c292402fdb4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fdad expref: 14 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022076:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030a00/0x167e6c292402fdb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fdad expref: 14 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022106:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022113:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788197397.022128:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003273255s 00010000:00010000:3.0:1788197397.022132:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022138:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022144:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022149:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022154:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7c00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197397.022158:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022165:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022175:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022184:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197397.022248:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7066c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3311:x1875060776248064:12345-0@lo:103: Request processed in 210us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197397.022262:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788197397.022335:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776248064:0@lo:103: 00010000:00010000:3.0:1788197397.022367:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030a00/0x167e6c292402fdb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fdad expref: 13 pid: 5833 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197397.022378:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875060776247936:0@lo:104: 00010000:00010000:3.0:1788197397.022389:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022397:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022403:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197397.022408:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7c00/0x167e6c292402fe55 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197397.029149:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:6694:x1875060776247808:12345-0@lo:253: Request processed in 57444us (60976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197397.029165:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788197397.029353:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:6694:1875060776247808:0@lo:253: 10000000:01000000:0.0:1788197397.029387:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788197397.029390:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788197397.029392:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788197397.029393:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197397.029394:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197397.029395:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197397.029396:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197397.029398:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197397.029400:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788197397.029402:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788197397.029404:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197397.029405:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788197397.029434:0:6694:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788197397.036373:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788197397.036672:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788197397.037037:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788197397.037317:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788197397.037628:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788197397.038117:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788197397.044909:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788197397.102913:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788197397.295253:0:6694:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788197397.295262:0:6694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788197397.295300:0:6694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788197397.295361:0:6694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788197397.295378:0:6694:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788197397.295486:0:6694:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788197398.126064:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197399.171342:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197400.175035:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197401.198043:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197401.967012:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776248320:0@lo:400: 00000100:00100000:1.0:1788197401.967092:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197401.967159:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788197401.967166:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776248192:0@lo:400: 00000100:00100000:2.0:1788197401.967192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248320 00000100:00100000:1.0:1788197401.967194:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197401.967199:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248320 00000100:00100000:1.0:1788197401.967221:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788197401.967228:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776248448:0@lo:400: 00000100:00100000:2.0:1788197401.967240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788197401.967248:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776248320:12345-0@lo:400: 00000100:00100000:1.0:1788197401.967250:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197401.967279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248192 00000100:00100000:1.0:1788197401.967282:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248192 00000100:00100000:2.0:1788197401.967296:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776248320:12345-0@lo:400: Request processed in 49us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197401.967303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197401.967307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788197401.967312:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3314:x1875060776248192:12345-0@lo:400: 00000100:00100000:2.0:1788197401.967316:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248448 00000100:00100000:2.0:1788197401.967319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248448 00000100:00100000:1.0:1788197401.967341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3314:x1875060776248192:12345-0@lo:400: Request processed in 29us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197401.967353:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788197401.967356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788197401.967359:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776248448:12345-0@lo:400: 00000100:00100000:2.0:1788197401.967400:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776248448:12345-0@lo:400: Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197401.967406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788197401.967413:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788197401.967440:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c708388e00 x1875060776248448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197401.967453:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776248448:0@lo:400: 00000100:00100000:1.0:1788197401.967480:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776248192:0@lo:400: 00010000:00080000:1.0:1788197401.967490:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c70838aa00 x1875060776248320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197401.967498:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776248320:0@lo:400: 00010000:00010000:0.0:1788197402.229667:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197403.250856:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197404.270704:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788197405.098170:0:7061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788197405.296066:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788197406.064548:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788197406.064554:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c706bce800 from 21 10000000:01000000:3.0:1788197406.064559:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788197406.064609:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197406.064620:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197406.064631:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197406.064692:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776248576:0@lo:101: 00000100:00100000:3.0:1788197406.064807:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197406.065619:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706205600 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.066101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248576 00000100:00100000:2.0:1788197406.066129:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248576 00000100:00100000:2.0:1788197406.066235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788197406.066259:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776248576:12345-0@lo:101: 00010000:00010000:2.0:1788197406.066308:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197406.066369:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fe5c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.066469:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fe5c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.066527:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe5c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.066537:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143400, rc 0) 00000100:00100000:2.0:1788197406.066669:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776248576:12345-0@lo:101: Request processed in 418us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.066676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788197406.067091:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776248576:0@lo:101: 00010000:00010000:2.0:1788197406.067110:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.067121:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197406.067189:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776248704:0@lo:501: 00000100:00100000:2.0:1788197406.067223:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.067254:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e76840 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.067270:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248704 00000100:00100000:2.0:1788197406.067275:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248704 00000100:00100000:2.0:1788197406.067300:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788197406.067318:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776248704:12345-0@lo:501: 00000100:00100000:2.0:1788197406.067684:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776248704:12345-0@lo:501: Request processed in 366us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.067692:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788197406.067726:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776248704:0@lo:501: 00000100:00100000:2.0:1788197406.067753:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776248832:0@lo:503: 00000100:00100000:2.0:1788197406.067790:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.067804:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e76840 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.067815:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248832 00000100:00100000:2.0:1788197406.067819:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248832 00000100:00100000:2.0:1788197406.067898:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788197406.067904:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776248832:12345-0@lo:503: 00000100:00100000:2.0:1788197406.068202:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776248832:12345-0@lo:503: Request processed in 297us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.068209:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788197406.068273:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776248832:0@lo:503: 00000100:00100000:2.0:1788197406.068572:0:7110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7110:1875060776248960:0@lo:502: 00000100:00100000:2.0:1788197406.068637:0:7110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.068674:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776248960 00000100:00100000:2.0:1788197406.068678:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776248960 00000100:00100000:2.0:1788197406.068764:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788197406.068772:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7110:x1875060776248960:12345-0@lo:502: 00000100:00100000:2.0:1788197406.069086:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7110:x1875060776248960:12345-0@lo:502: Request processed in 315us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.069104:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788197406.069180:0:7110:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.069219:0:7110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7110:1875060776248960:0@lo:502: 00000100:00100000:2.0:1788197406.069287:0:7110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7110:1875060776249088:0@lo:502: 00000100:00100000:2.0:1788197406.069332:0:7110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.069369:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249088 00000100:00100000:2.0:1788197406.069373:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249088 00000100:00100000:2.0:1788197406.069395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788197406.069401:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7110:x1875060776249088:12345-0@lo:502: 00000100:00100000:2.0:1788197406.069544:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7110:x1875060776249088:12345-0@lo:502: Request processed in 142us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.069550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788197406.069615:0:7110:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.069627:0:7110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7110:1875060776249088:0@lo:502: 00000040:00080000:2.0:1788197406.069661:0:7110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788197406.069755:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788197406.069786:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788197406.069795:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.069805:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197406.069814:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788197406.069816:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c706bce800 from 4 10000000:01000000:2.0:1788197406.069819:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788197406.069864:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.069881:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.069890:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197406.069903:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249216:0@lo:101: 00000100:00100000:2.0:1788197406.078796:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.078880:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249216 00000100:00100000:2.0:1788197406.078891:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249216 00000100:00100000:2.0:1788197406.078934:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788197406.078944:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776249216:12345-0@lo:101: 00010000:00010000:2.0:1788197406.078962:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197406.078983:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fe6a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.079015:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fe6a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.080980:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe6a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.080999:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143a00, rc 0) 00000100:00100000:2.0:1788197406.081082:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776249216:12345-0@lo:101: Request processed in 2138us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.081090:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788197406.081156:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.081178:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249216:0@lo:101: 00010000:00010000:2.0:1788197406.081210:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.081221:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197406.081284:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249344:0@lo:256: 00000100:00100000:2.0:1788197406.081317:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.081347:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197406.081404:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249344 00000100:00100000:3.0:1788197406.081410:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249344 00000100:00100000:3.0:1788197406.081451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788197406.081459:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776249344:12345-0@lo:256: 20000000:01000000:3.0:1788197406.081479:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788197406.081496:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788197406.081500:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788197406.081563:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776249344:12345-0@lo:256: Request processed in 105us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197406.081570:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788197406.081918:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249344:0@lo:256: 10000000:01000000:2.0:1788197406.081962:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788197406.081969:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.081978:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197406.081987:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788197406.081989:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788197406.081993:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788197406.082018:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.082025:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.082034:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197406.082056:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249472:0@lo:101: 00000100:00100000:2.0:1788197406.082084:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.082108:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197406.082914:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249472 00000100:00100000:3.0:1788197406.082923:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249472 00000100:00100000:3.0:1788197406.082959:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788197406.082967:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776249472:12345-0@lo:101: 00010000:00010000:3.0:1788197406.082978:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197406.082991:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fe78 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197406.083013:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fe78 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197406.083023:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe78 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197406.083032:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7400, rc 0) 00000100:00100000:3.0:1788197406.083098:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776249472:12345-0@lo:101: Request processed in 131us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197406.083104:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788197406.083521:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249472:0@lo:101: 00010000:00010000:1.0:1788197406.083537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197406.083546:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197406.083624:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249600:0@lo:501: 00000100:00100000:1.0:1788197406.083666:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197406.083692:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.083862:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249600 00000100:00100000:2.0:1788197406.083867:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249600 00000100:00100000:2.0:1788197406.083898:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788197406.083906:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776249600:12345-0@lo:501: 00000100:00100000:2.0:1788197406.084161:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776249600:12345-0@lo:501: Request processed in 255us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.084168:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788197406.084202:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249600:0@lo:501: 00000100:00100000:2.0:1788197406.084230:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249728:0@lo:503: 00000100:00100000:2.0:1788197406.084268:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.084288:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249728 00000100:00100000:2.0:1788197406.084291:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249728 00000100:00100000:2.0:1788197406.084312:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788197406.084318:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776249728:12345-0@lo:503: 00000100:00100000:2.0:1788197406.084601:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776249728:12345-0@lo:503: Request processed in 282us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.084608:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788197406.084643:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.084670:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776249728:0@lo:503: 00000100:00100000:2.0:1788197406.084925:0:7112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7112:1875060776249856:0@lo:502: 00000100:00100000:2.0:1788197406.084957:0:7112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.084983:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249856 00000100:00100000:2.0:1788197406.084986:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249856 00000100:00100000:2.0:1788197406.085007:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788197406.085013:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:7112:x1875060776249856:12345-0@lo:502: 00000100:00100000:2.0:1788197406.085197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:7112:x1875060776249856:12345-0@lo:502: Request processed in 183us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.085204:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788197406.085233:0:7112:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706b94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.085245:0:7112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7112:1875060776249856:0@lo:502: 00000020:01000000:2.0:1788197406.085264:0:7112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788197406.085272:0:7112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788197406.085279:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197406.085281:0:7112:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788197406.085286:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788197406.085290:0:7112:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000020:01000000:2.0:1788197406.085312:0:7112:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788197406.085316:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788197406.085331:0:7112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93c73cff0000) 00000020:00000080:2.0:1788197406.085351:0:7112:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788197406.085356:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788197406.085427:0:7112:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788197406.085433:0:7112:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788197406.085444:0:7112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292402fe8d 00010000:00080000:2.0:1788197406.085474:0:7112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c717bde000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:2.0:1788197406.085693:0:7112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788197406.176718:0:7112:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788197406.176741:0:7112:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788197406.179016:0:7112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788197406.179195:0:7112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788197406.179247:0:7112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788197406.179320:0:7112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788197406.181170:0:7123:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788197406.181176:0:7123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788197406.182130:0:7112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788197406.182144:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788197406.182174:0:7112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788197406.182193:0:7112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c292402fe94 00000100:00080000:2.0:1788197406.182203:0:7112:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788197406.182208:0:7112:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c717bde000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1788197406.182244:0:7112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c2e2a00 x1875060776249984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788197406.182269:0:7112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788197406.182326:0:7112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197406.182330:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197406.182332:0:7112:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788197406.182335:0:7112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197406.182339:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197406.182340:0:7112:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788197406.182342:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788197406.182344:0:7112:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788197406.182453:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776249984:0@lo:8: 00000100:00100000:1.0:1788197406.182524:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197406.182607:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776249984 00000100:00100000:1.0:1788197406.182623:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776249984 00000100:00100000:1.0:1788197406.182655:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197406.182661:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875060776249984:12345-0@lo:8: 00010000:00080000:1.0:1788197406.182684:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1788197406.182713:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c292402fe9b 00002000:00100000:1.0:1788197406.182744:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93c73f140000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788197406.182749:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788197406.182754:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788197406.182916:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788197406.183048:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788197406.183076:0:6696:0:(import.c:65:import_set_state_nolock()) ffff93c73f147800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197406.183141:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875060776249984:12345-0@lo:8: Request processed in 478us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197406.183150:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788197406.183193:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e2a00 x1875060776249984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788197416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197406.183203:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788197406.183211:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788197406.183218:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788197406.183222:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788197406.183224:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c717bde000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788197406.183233:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788197406.183239:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776249984:0@lo:8: 00000004:00080000:1.0:1788197406.183259:0:7123:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788197406.183350:0:7123:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 202329526951ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788197406.183692:0:7112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7112:1875060776250112:0@lo:502: 00000100:00100000:2.0:1788197406.183743:0:7112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.183762:0:7112:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706b94480 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.183985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776250112 00000100:00100000:2.0:1788197406.183990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776250112 00000100:00100000:2.0:1788197406.184021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788197406.184028:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:7112:x1875060776250112:12345-0@lo:502: 00000100:00100000:1.0:1788197406.184505:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776250240:0@lo:400: 00000100:00100000:1.0:1788197406.184550:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197406.184605:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776250240 00000100:00100000:1.0:1788197406.184609:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776250240 00000100:00100000:1.0:1788197406.184634:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788197406.184641:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776250240:12345-0@lo:400: 00000100:00100000:1.0:1788197406.184682:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776250240:12345-0@lo:400: Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197406.184688:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788197406.184721:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e3b80 x1875060776250240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197406.184732:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776250240:0@lo:400: 00000100:00100000:2.0:1788197406.185211:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:7112:x1875060776250112:12345-0@lo:502: Request processed in 1182us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.185218:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788197406.185270:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776250368:0@lo:400: 00000100:00100000:2.0:1788197406.185304:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.185407:0:7112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7112:1875060776250112:0@lo:502: 00000020:01000000:2.0:1788197406.185432:0:7112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197406.185438:0:7112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197406.185440:0:7112:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788197406.185444:0:7112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788197406.185552:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788197406.185572:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788197406.185600:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.185611:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197406.185621:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788197406.185623:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c70623b370 from 1 10000000:01000000:2.0:1788197406.185626:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788197406.185653:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.185660:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.185669:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197406.185683:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776250496:0@lo:101: 00000100:00100000:2.0:1788197406.185711:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.185728:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.185742:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776250496 00000100:00100000:2.0:1788197406.185751:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776250496 00000100:00100000:2.0:1788197406.185793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788197406.185801:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776250496:12345-0@lo:101: 00010000:00010000:2.0:1788197406.186085:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197406.186097:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fea2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.186118:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fea2 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.186127:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fea2 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.186135:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143200, rc 0) 00000100:00100000:2.0:1788197406.186168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776250496:12345-0@lo:101: Request processed in 368us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.186174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788197406.186220:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776250496:0@lo:101: 00010000:00010000:2.0:1788197406.186233:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.186241:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197406.186283:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776250624:0@lo:501: 00000100:00100000:2.0:1788197406.186307:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.186331:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.186345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776250624 00000100:00100000:2.0:1788197406.186349:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776250624 00000100:00100000:2.0:1788197406.186391:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788197406.186397:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776250624:12345-0@lo:501: 00000100:00100000:2.0:1788197406.186609:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776250624:12345-0@lo:501: Request processed in 212us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788197406.186616:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788197406.186647:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776250624:0@lo:501: 10000000:01000000:2.0:1788197406.186666:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788197406.186671:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197406.186678:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197406.189536:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776250368 00000100:00100000:2.0:1788197406.189551:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776250368 00000100:00100000:2.0:1788197406.189635:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788197406.189644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776250368:12345-0@lo:400: 00000100:00100000:2.0:1788197406.189735:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776250368:12345-0@lo:400: Request processed in 92us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.189743:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788197406.189801:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e0000 x1875060776250368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197406.189840:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776250368:0@lo:400: 00000100:00080000:1.0:1788197406.190066:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788197406.298080:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788197406.299918:0:7124:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788197406.299961:0:7124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776250880:0@lo:7: 00000100:00100000:1.0:1788197406.300046:0:7124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197406.300099:0:7124:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737182000 going to sleep for 11 seconds 00000100:00100000:2.0:1788197406.300261:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776250752:0@lo:13: 00000100:00100000:2.0:1788197406.300300:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.300353:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776250880 00000100:00100000:2.0:1788197406.300370:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776250880 00000100:00100000:2.0:1788197406.300599:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197406.300610:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7124:x1875060776250880:12345-0@lo:7: 00000100:00100000:1.0:1788197406.301856:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776250752 00000100:00100000:1.0:1788197406.301866:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776250752 00000100:00100000:1.0:1788197406.301903:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197406.301911:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875060776250752:12345-0@lo:13: 00002000:00000024:1.0:1788197406.301941:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788197406.302015:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875060776250752:12345-0@lo:13: Request processed in 104us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197406.302021:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788197406.311086:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788197406.313543:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788197406.313553:0:6699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788197406.313684:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7124:x1875060776250880:12345-0@lo:7: Request processed in 13069us (13631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.313695:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788197406.316768:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c708388700 x1875060776250752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197406.316795:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776250752:0@lo:13: 00010000:00080000:2.0:1788197406.316860:0:7124:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c708389880 x1875060776250880/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788197422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197406.316870:0:7124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776250880:0@lo:7: 00000004:00080000:2.0:1788197406.316880:0:7124:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788197406.316914:0:7124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776251008:0@lo:5: 00000100:00100000:2.0:1788197406.316968:0:7124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.317011:0:7124:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7085fc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788197406.319630:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251008 00000100:00100000:1.0:1788197406.319657:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251008 00000100:00100000:1.0:1788197406.319722:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197406.319732:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7124:x1875060776251008:12345-0@lo:5: 00002000:00080000:1.0:1788197406.319761:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788197406.319764:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788197406.320130:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7124:x1875060776251008:12345-0@lo:5: Request processed in 398us (3160us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788197406.320138:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788197406.321906:0:7124:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e0e00 x1875060776251008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788197422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197406.321926:0:7124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776251008:0@lo:5: 00000004:00080000:1.0:1788197406.321939:0:7124:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788197406.321976:0:7124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776251136:0@lo:700: 00000100:00100000:1.0:1788197406.322023:0:7124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197406.322068:0:7124:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737182180 going to sleep for 11 seconds 00010000:00010000:2.0:1788197406.322167:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197406.326425:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251136 00000100:00100000:3.0:1788197406.326441:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251136 00000100:00100000:3.0:1788197406.326492:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788197406.326501:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7124:x1875060776251136:12345-0@lo:700: 00000100:00100000:3.0:1788197406.326555:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1875060776251264:0@lo:700: 00000100:00100000:3.0:1788197406.326637:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197406.326669:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788197406.326859:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251264 00000100:00100000:1.0:1788197406.326864:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251264 00000100:00100000:1.0:1788197406.326895:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197406.326902:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1875060776251264:12345-0@lo:700: 40000000:02000000:1.0:1788197406.390412:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788197406.398209:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1875060776251264:12345-0@lo:700: Request processed in 71296us (71560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197406.398230:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788197406.398359:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c70480e680 x1875060776251264/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788197422 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197406.398453:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1875060776251264:0@lo:700: 40000000:02000000:3.0:1788197406.398470:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788197406.494440:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788197406.494459:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788197406.494702:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7124:x1875060776251136:12345-0@lo:700: Request processed in 168197us (172673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197406.494722:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788197406.494910:0:7124:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c70838a680 x1875060776251136/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788197422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197406.494923:0:7124:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788197406.494959:0:7124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776251136:0@lo:700: 00000004:02000040:2.0:1788197406.522111:0:7124:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788197406.526119:0:7124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776251392:0@lo:5: 00000100:00100000:2.0:1788197406.526182:0:7124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197406.526338:0:7124:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706b940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197406.526434:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251392 00000100:00100000:1.0:1788197406.526442:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251392 00000100:00100000:1.0:1788197406.526540:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197406.526549:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7124:x1875060776251392:12345-0@lo:5: 00002000:00080000:1.0:1788197406.532010:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788197406.532032:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788197406.538945:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7124:x1875060776251392:12345-0@lo:5: Request processed in 12386us (12751us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788197406.538961:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788197406.539535:0:7124:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e0e00 x1875060776251392/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788197422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197406.539553:0:7124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7124:1875060776251392:0@lo:5: 00000004:00080000:2.0:1788197406.539568:0:7124:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788197407.342055:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197408.368473:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197409.390064:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197410.425184:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788197410.464438:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1788197411.183706:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776251648:0@lo:400: 00000100:00100000:0.0:1788197411.183802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197411.183895:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788197411.183902:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776251520:0@lo:400: 00000100:00100000:0.0:1788197411.183966:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197411.184016:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251520 00000100:00100000:0.0:1788197411.184024:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251520 00000100:00100000:0.0:1788197411.184072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788197411.184084:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3312:x1875060776251520:12345-0@lo:400: 00000100:00100000:0.0:1788197411.184140:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3312:x1875060776251520:12345-0@lo:400: Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197411.184147:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788197411.184206:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776251520:0@lo:400: 00000100:00100000:2.0:1788197411.184312:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776251776:0@lo:400: 00000100:00100000:2.0:1788197411.184359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197411.184398:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788197411.184406:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776251904:0@lo:400: 00000100:00100000:2.0:1788197411.184440:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197411.184706:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251648 00000100:00100000:3.0:1788197411.184712:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251648 00000100:00100000:3.0:1788197411.184750:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251776 00000100:00100000:3.0:1788197411.184754:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251776 00000100:00100000:3.0:1788197411.184797:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788197411.184804:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776251648:12345-0@lo:400: 00000100:00100000:3.0:1788197411.184872:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776251648:12345-0@lo:400: Request processed in 68us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197411.184891:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788197411.184909:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788197411.184915:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776251776:12345-0@lo:400: 00000100:00100000:3.0:1788197411.184947:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776251776:12345-0@lo:400: Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197411.184953:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788197411.185094:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c70480f480 x1875060776251648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197411.185108:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776251648:0@lo:400: 00010000:00080000:2.0:1788197411.185209:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c70480d180 x1875060776251776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197411.185219:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776251776:0@lo:400: 00000100:00100000:0.0:1788197411.185285:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776251904 00000100:00100000:0.0:1788197411.185290:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776251904 00000100:00100000:0.0:1788197411.185325:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788197411.185332:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776251904:12345-0@lo:400: 00000100:00100000:0.0:1788197411.185402:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776251904:12345-0@lo:400: Request processed in 69us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197411.185408:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788197411.185452:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c70480c380 x1875060776251904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197411.185460:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788197411.185471:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776251904:0@lo:400: 00000100:00080000:2.0:1788197411.185875:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197411.185880:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788197411.442446:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197411.694020:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788197411.694048:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776252032:0@lo:13: 00000100:00100000:1.0:1788197411.694133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197411.705233:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252032 00000100:00100000:1.0:1788197411.705254:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252032 00000100:00100000:1.0:1788197411.705338:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788197411.705353:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776252032:12345-0@lo:13: 00002000:00000024:1.0:1788197411.705400:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197411.705505:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776252032:12345-0@lo:13: Request processed in 156us (11372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197411.705513:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788197411.705572:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c70838b800 x1875060776252032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197411.706158:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776252032:0@lo:13: 00010000:00010000:2.0:1788197412.464794:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197413.489383:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197414.511001:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197415.540851:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197416.302681:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197416.303097:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788197416.303120:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776252544:0@lo:400: 00000100:00100000:0.0:1788197416.303211:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197416.303295:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776252288:0@lo:400: 00000100:00100000:0.0:1788197416.303337:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197416.303359:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197416.303365:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776252416:0@lo:400: 00000100:00100000:0.0:1788197416.303391:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197416.303431:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252544 00000100:00100000:0.0:1788197416.303447:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252544 00000100:00100000:0.0:1788197416.303522:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197416.303541:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776252544:12345-0@lo:400: 00000100:00100000:0.0:1788197416.303593:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776252544:12345-0@lo:400: Request processed in 54us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197416.303600:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197416.303624:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252288 00000100:00100000:0.0:1788197416.303628:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252288 00000100:00100000:0.0:1788197416.303651:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252416 00000100:00100000:0.0:1788197416.303653:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252416 00000100:00100000:0.0:1788197416.303674:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788197416.303680:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776252288:12345-0@lo:400: 00000100:00100000:0.0:1788197416.303714:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776252288:12345-0@lo:400: Request processed in 34us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197416.303720:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788197416.303730:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788197416.303735:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776252416:12345-0@lo:400: 00000100:00100000:0.0:1788197416.303758:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776252416:12345-0@lo:400: Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197416.303764:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788197416.303781:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788197416.303786:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788197416.303851:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e1c00 x1875060776252416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197416.303866:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776252416:0@lo:400: 00010000:00080000:0.0:1788197416.303878:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e1f80 x1875060776252288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197416.303901:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776252288:0@lo:400: 00010000:00080000:0.0:1788197416.303936:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e3800 x1875060776252544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197416.303944:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776252544:0@lo:400: 00000100:00100000:3.0:1788197416.308660:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776252160:0@lo:400: 00000100:00100000:3.0:1788197416.308743:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197416.309024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252160 00000100:00100000:0.0:1788197416.309034:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252160 00000100:00100000:0.0:1788197416.309091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788197416.309102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3311:x1875060776252160:12345-0@lo:400: 00000100:00100000:0.0:1788197416.309172:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3311:x1875060776252160:12345-0@lo:400: Request processed in 71us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197416.309180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788197416.309239:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776252160:0@lo:400: 00010000:00010000:2.0:1788197416.558025:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197416.828951:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197416.828981:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776252672:0@lo:13: 00000100:00100000:1.0:1788197416.829051:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197416.832349:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252672 00000100:00100000:2.0:1788197416.832363:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252672 00000100:00100000:2.0:1788197416.832441:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788197416.832450:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776252672:12345-0@lo:13: 00002000:00000024:2.0:1788197416.832483:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197416.832576:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776252672:12345-0@lo:13: Request processed in 127us (3525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197416.832583:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788197416.835324:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e2300 x1875060776252672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197416.835352:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776252672:0@lo:13: 00010000:00010000:3.0:1788197417.584910:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788197417.850126:0:7645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788197417.850130:0:7645:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788197417.850472:0:7645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c736929000 00000020:01000004:3.0:1788197417.850488:0:7645:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788197417.850500:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788197417.850513:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93c73c2fb370) 00000020:00000080:3.0:1788197417.850539:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788197417.896564:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788197417.899281:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788197417.976091:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788197417.989546:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788197417.989588:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788197417.989660:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788197417.989694:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788197417.994548:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788197417.994566:0:7645:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788197417.994582:0:7645:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x167e6c292402feb7 00000020:01000004:3.0:1788197417.994593:0:7645:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788197417.994624:0:7645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788197417.994628:0:7645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788197417.994634:0:7645:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788197417.994659:0:7645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788197417.994663:0:7645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788197418.051781:0:7645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788197418.052169:0:7645:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.140@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788197418.052175:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788197418.052177:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788197418.052178:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197418.052180:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197418.052181:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197418.052183:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197418.052185:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788197418.052187:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788197418.052188:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788197418.052190:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197418.052192:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788197418.052196:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788197418.052199:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788197418.052200:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788197418.052201:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197418.052203:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197418.052204:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197418.052205:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197418.052206:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788197418.052207:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788197418.052208:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788197418.052209:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197418.052211:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788197418.052238:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788197418.052271:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776252800:0@lo:253: 00000100:00100000:3.0:1788197418.052928:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.053077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252800 00000100:00100000:0.0:1788197418.053087:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252800 00000100:00100000:0.0:1788197418.053146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788197418.053156:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:7645:x1875060776252800:12345-0@lo:253: 20000000:01000000:0.0:1788197418.053205:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788197418.053209:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788197418.053214:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788197418.053217:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788197418.054577:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197418.054774:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788197418.054795:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788197418.054864:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788197418.054872:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788197418.054902:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000100:00100000:3.0:1788197418.055179:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706655000 going to sleep for 11 seconds 00000040:00080000:0.0:1788197418.055455:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788197418.055812:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788197418.059646:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:0.0:1788197418.059652:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:0.0:1788197418.059764:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788197418.059777:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788197418.059916:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788197418.059925:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:0.0:1788197418.062024:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788197418.062047:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788197418.062109:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788197418.062205:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788197418.066587:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788197418.066762:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.140@tcp 20000000:01000000:0.0:1788197418.066766:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.140@tcp (null) (null) (null) 00000040:00080000:0.0:1788197418.066810:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788197418.066857:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788197418.067173:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788197418.067186:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.140@tcp (null) (null) 00000040:00080000:0.0:1788197418.067221:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788197418.067230:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788197418.067444:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788197418.067483:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788197418.067503:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788197418.067507:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788197418.067513:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788197418.067526:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788197418.067536:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788197418.067548:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788197418.067550:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788197418.067591:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788197418.067594:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788197418.068807:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788197418.069440:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788197418.069536:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788197418.070765:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788197418.070816:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788197418.071077:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788197418.071105:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788197418.071109:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788197418.071665:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788197418.071924:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788197418.071960:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788197418.072024:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788197418.072038:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788197418.072040:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788197418.072907:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788197418.072973:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788197418.073028:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788197418.073790:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788197418.073863:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788197418.073905:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788197418.073919:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788197418.073921:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788197418.075554:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788197418.075721:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788197418.075755:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788197418.090359:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788197418.090444:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788197418.090525:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1788197418.090554:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788197418.090577:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.090595:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe08 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.091525:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe32 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.091534:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe5c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.091541:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe78 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.091548:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fea2 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.091556:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.092061:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fea2 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.092077:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fea2 expref: 16 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.092374:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776252928:0@lo:104: 00000100:00100000:3.0:1788197418.092444:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788197418.092501:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fe78 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.092509:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fe78 expref: 16 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.092529:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253056:0@lo:104: 00010000:00010000:3.0:1788197418.092554:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fe5c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.092562:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fe5c expref: 16 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.092569:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253184:0@lo:104: 00010000:00010000:3.0:1788197418.092595:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fe32 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197418.093051:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788197418.093073:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788197418.093162:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fe32 expref: 16 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.093173:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253312:0@lo:104: 00000100:00100000:2.0:1788197418.093326:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.097937:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197418.102605:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776252928 00000100:00100000:1.0:1788197418.102621:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776252928 00000100:00100000:1.0:1788197418.102685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253056 00000100:00100000:1.0:1788197418.102689:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253056 00000100:00100000:1.0:1788197418.102701:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253184 00000100:00100000:1.0:1788197418.102704:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253184 00000100:00100000:1.0:1788197418.102738:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788197418.102747:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c704c92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:5836:x1875060776252928:12345-0@lo:104: 00010000:00010000:1.0:1788197418.102765:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197418.102870:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788197418.102877:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c704c92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:5836:x1875060776252928:12345-0@lo:104: Request processed in 132us (10433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.102884:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788197418.103060:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197418.103067:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.103076:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742142400 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197418.103081:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.103101:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197418.103109:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197418.103115:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197418.103157:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.103164:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197418.103185:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.103192:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c292402fea2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fea9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.103207:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.103209:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.103211:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197418.103226:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776253440:0@lo:103: 00000100:00100000:3.0:1788197418.103295:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.103370:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253440 00000100:00100000:3.0:1788197418.103375:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253440 00010000:00010000:3.0:1788197418.103396:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fea2 expref: 17 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.103419:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788197418.103426:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3313:x1875060776253440:12345-0@lo:103: 00010000:00010000:3.0:1788197418.103438:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197418.103444:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fea2 expref: 17 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.103455:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fea2 expref: 17 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.103472:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197418.103500:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3313:x1875060776253440:12345-0@lo:103: Request processed in 74us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.103507:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788197418.103557:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776253440:0@lo:103: 00000100:00100000:1.0:1788197418.104485:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788197418.104496:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:5836:x1875060776253056:12345-0@lo:104: 00010000:00010000:1.0:1788197418.104509:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197418.104582:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788197418.104588:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:5836:x1875060776253056:12345-0@lo:104: Request processed in 95us (11515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.104594:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788197418.105469:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197418.105478:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.105486:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742142800 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197418.105490:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.105498:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197418.105535:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197418.105541:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197418.105572:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.105578:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197418.105610:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.105618:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402fe78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe7f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.105633:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.105634:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.105636:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197418.105652:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776253568:0@lo:103: 00000100:00100000:3.0:1788197418.105697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.105754:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253568 00000100:00100000:3.0:1788197418.105760:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253568 00010000:00010000:3.0:1788197418.105782:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe78 expref: 17 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.105809:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788197418.105817:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3314:x1875060776253568:12345-0@lo:103: 00010000:00010000:3.0:1788197418.105844:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197418.105849:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe78 expref: 17 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.105866:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fe78 expref: 17 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.105884:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197418.105931:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3314:x1875060776253568:12345-0@lo:103: Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.105939:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788197418.105974:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776253568:0@lo:103: 00000100:00100000:1.0:1788197418.106709:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788197418.106724:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5836:x1875060776253184:12345-0@lo:104: 00010000:00010000:1.0:1788197418.106738:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197418.106807:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788197418.106812:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5836:x1875060776253184:12345-0@lo:104: Request processed in 95us (13487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.106819:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788197418.107189:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197418.107196:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.107203:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7c00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197418.107207:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.107214:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197418.107220:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197418.107226:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197418.108206:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.108216:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197418.108236:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.108271:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fe5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe63 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.108289:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.108290:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.108293:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197418.108302:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197418.108319:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776253696:0@lo:103: 00000100:00100000:3.0:1788197418.108374:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.108430:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253696 00000100:00100000:3.0:1788197418.108437:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253696 00010000:00010000:3.0:1788197418.108464:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe5c expref: 17 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.108487:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788197418.108494:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3312:x1875060776253696:12345-0@lo:103: 00010000:00010000:3.0:1788197418.108506:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197418.108510:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe5c expref: 17 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.108532:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fe5c expref: 17 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.108547:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197418.108574:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3312:x1875060776253696:12345-0@lo:103: Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.108586:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788197418.108620:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776253696:0@lo:103: 00010000:00010000:2.0:1788197418.114421:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fe08 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.114440:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fe08 expref: 16 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197418.114455:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253824:0@lo:104: 00000100:00100000:2.0:1788197418.114530:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.124082:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709ba80 going to sleep for 11 seconds 00010000:00010000:0.0:1788197418.124135:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143200/0x167e6c292402fea9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fea2 expref: 16 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197418.124158:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776252928:0@lo:104: 00010000:00010000:0.0:1788197418.124172:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7400/0x167e6c292402fe7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fe78 expref: 15 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197418.124181:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253056:0@lo:104: 00010000:00010000:0.0:1788197418.124191:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143400/0x167e6c292402fe63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fe5c expref: 14 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197418.124199:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253184:0@lo:104: 00000100:00100000:1.0:1788197418.124915:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253312 00000100:00100000:1.0:1788197418.124934:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253312 00000100:00100000:3.0:1788197418.126578:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253824 00000100:00100000:3.0:1788197418.126588:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253824 00000100:00100000:3.0:1788197418.126643:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788197418.126653:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:5836:x1875060776253312:12345-0@lo:104: 00010000:00010000:3.0:1788197418.126670:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.127788:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788197418.127800:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:5836:x1875060776253312:12345-0@lo:104: Request processed in 1146us (29867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.127809:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788197418.127858:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788197418.127867:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5836:x1875060776253824:12345-0@lo:104: 00010000:00010000:3.0:1788197418.127879:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.128856:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197418.128867:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.128876:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197418.128880:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.128889:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197418.128923:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197418.128929:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197418.128981:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.128988:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197418.129018:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.129025:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402fe32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe39 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.129042:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197418.129044:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197418.129046:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197418.134749:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776253952:0@lo:103: 00000100:00100000:3.0:1788197418.134847:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788197418.134964:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788197418.134971:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5836:x1875060776253824:12345-0@lo:104: Request processed in 7106us (20441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.134981:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788197418.135004:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197418.135012:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135022:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6c00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197418.135032:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135051:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197418.135059:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197418.135065:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197418.135254:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135261:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197418.135373:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135381:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fe08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe0f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135397:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.135400:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.135401:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197418.135414:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788197418.135423:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776254080:0@lo:103: 00000100:00100000:3.0:1788197418.135448:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.135473:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776253952 00000100:00100000:3.0:1788197418.135478:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776253952 00010000:00010000:3.0:1788197418.135501:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe32 expref: 14 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.135533:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254080 00000100:00100000:3.0:1788197418.135541:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254080 00010000:00010000:3.0:1788197418.135561:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe08 expref: 15 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.135575:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788197418.135582:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:3312:x1875060776253952:12345-0@lo:103: 00010000:00010000:3.0:1788197418.135591:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197418.135596:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe32 expref: 15 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135606:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fe32 expref: 15 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135621:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197418.135646:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:3312:x1875060776253952:12345-0@lo:103: Request processed in 64us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.135651:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788197418.135664:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788197418.135670:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3314:x1875060776254080:12345-0@lo:103: 00010000:00010000:3.0:1788197418.135676:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197418.135680:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe08 expref: 14 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135688:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fe08 expref: 14 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135699:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135708:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135727:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135734:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135741:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135747:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135752:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197418.135756:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135763:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135770:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.135777:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197418.135801:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3314:x1875060776254080:12345-0@lo:103: Request processed in 130us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.135806:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788197418.135865:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776253952:0@lo:103: 00000100:00100000:3.0:1788197418.136209:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776254080:0@lo:103: 00010000:00010000:0.0:1788197418.139460:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6000/0x167e6c292402fe39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fe32 expref: 13 pid: 5833 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197418.139488:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253312:0@lo:104: 00010000:00010000:0.0:1788197418.139505:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142200/0x167e6c292402fe0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fe08 expref: 12 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197418.139527:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1875060776253824:0@lo:104: 00010000:00010000:0.0:1788197418.139564:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.139574:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.139582:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.139587:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7200/0x167e6c292402febe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788197418.139685:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788197418.222562:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:7645:x1875060776252800:12345-0@lo:253: Request processed in 169396us (169623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.222580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788197418.222593:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776252800:0@lo:253: 10000000:01000000:3.0:1788197418.222638:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788197418.222641:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788197418.222643:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788197418.222644:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197418.222645:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788197418.222647:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197418.222648:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197418.222649:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788197418.222651:0:7645:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788197418.222653:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197418.222654:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788197418.222675:0:7645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c736929000 from lustre-OST0001 10000000:01000000:3.0:1788197418.222703:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788197418.222705:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788197418.222713:0:7645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c70623b370 local copy 10000000:01000000:3.0:1788197418.222717:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788197418.222750:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.222761:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.222770:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.222789:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254208:0@lo:101: 00000100:00100000:3.0:1788197418.222851:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.223060:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197418.223192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254208 00000100:00100000:0.0:1788197418.223199:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254208 00000100:00100000:0.0:1788197418.223256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788197418.223266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:7645:x1875060776254208:12345-0@lo:101: 00010000:00010000:0.0:1788197418.223665:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197418.223680:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030600/0x167e6c292402fecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fec5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.223704:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030600/0x167e6c292402fecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fec5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.223724:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030600/0x167e6c292402fecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fec5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.223733:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030600, rc 0) 00000100:00100000:0.0:1788197418.223782:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254208:12345-0@lo:101: Request processed in 517us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.223789:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788197418.224035:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254208:0@lo:101: 00010000:00010000:3.0:1788197418.224053:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.224074:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.224615:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254336:0@lo:501: 00000100:00100000:3.0:1788197418.224658:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.224700:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197418.224720:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254336 00000100:00100000:1.0:1788197418.224727:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254336 00000100:00100000:1.0:1788197418.224770:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788197418.224778:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254336:12345-0@lo:501: 00000100:00100000:1.0:1788197418.225545:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254336:12345-0@lo:501: Request processed in 765us (884us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788197418.225553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788197418.225710:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254336:0@lo:501: 10000000:01000000:3.0:1788197418.225725:0:7645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788197418.225757:0:7645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788197418.225764:0:7645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.225774:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.225781:0:7645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.225803:0:7645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197418.225873:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197418.225880:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.225887:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6c00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197418.225891:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.225900:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197418.225907:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197418.225921:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197418.225943:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.225949:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197418.225993:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.226003:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c292402fec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x167e6c292402fecc expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.226018:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197418.226020:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197418.226022:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197418.226123:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776254464:0@lo:103: 00000100:00100000:0.0:1788197418.226164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197418.226295:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254464 00000100:00100000:2.0:1788197418.226312:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254464 00000100:00100000:2.0:1788197418.226362:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197418.226369:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3314:x1875060776254464:12345-0@lo:103: 00010000:00010000:2.0:1788197418.226381:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197418.226395:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030600/0x167e6c292402fecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292402fec5 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.226408:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1788197418.226455:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c736929000 10000000:01000000:3.0:1788197418.226461:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788197418.226467:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788197418.226470:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788197418.226479:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788197418.226482:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788197418.226504:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.226534:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.226542:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.226555:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254592:0@lo:101: 00000100:00100000:3.0:1788197418.226583:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197418.226595:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:3314:x1875060776254464:12345-0@lo:103: Request processed in 226us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197418.226602:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197418.226713:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788197418.226791:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776254464:0@lo:103: 00000100:00100000:0.0:1788197418.228594:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254592 00000100:00100000:0.0:1788197418.228691:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254592 00000100:00100000:0.0:1788197418.228750:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788197418.228761:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+11:7645:x1875060776254592:12345-0@lo:101: 00010000:00010000:0.0:1788197418.228777:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197418.228796:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fed3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.228843:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fed3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.228855:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fed3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.228865:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030c00, rc 0) 00000100:00100000:0.0:1788197418.229073:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254592:12345-0@lo:101: Request processed in 312us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.229080:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788197418.229787:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254592:0@lo:101: 00010000:00010000:3.0:1788197418.229813:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.229862:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.230202:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254720:0@lo:501: 00000100:00100000:3.0:1788197418.230394:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.230440:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788197418.230554:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254720 00000100:00100000:2.0:1788197418.230562:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254720 00000100:00100000:2.0:1788197418.230614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788197418.230637:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254720:12345-0@lo:501: 00000100:00100000:2.0:1788197418.230944:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254720:12345-0@lo:501: Request processed in 307us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197418.230953:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788197418.231002:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254720:0@lo:501: 00000100:00100000:0.0:1788197418.231044:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254848:0@lo:503: 00000100:00100000:0.0:1788197418.238049:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197418.238249:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73bbab000 going to sleep for 11 seconds 00000100:00100000:3.0:1788197418.238269:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254848 00000100:00100000:3.0:1788197418.238288:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254848 00000100:00100000:3.0:1788197418.238347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788197418.238358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254848:12345-0@lo:503: 00000100:00100000:3.0:1788197418.238608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254848:12345-0@lo:503: Request processed in 241us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.238617:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788197418.238908:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254848:0@lo:503: 00000040:00080000:1.0:1788197418.239579:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788197418.239656:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708388380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254976:0@lo:502: 00000100:00100000:1.0:1788197418.239717:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197418.239763:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70940fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197418.240004:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776254976 00000100:00100000:3.0:1788197418.240011:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776254976 00000100:00100000:3.0:1788197418.240052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788197418.240061:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254976:12345-0@lo:502: 00000100:00100000:3.0:1788197418.240455:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776254976:12345-0@lo:502: Request processed in 394us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.240463:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788197418.240570:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708388380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776254976:0@lo:502: 00000040:00080000:1.0:1788197418.240885:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788197418.240938:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788197418.241255:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788197418.241445:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788197418.241493:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788197418.241545:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788197418.241584:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708388380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255104:0@lo:502: 00000100:00100000:1.0:1788197418.241642:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197418.241692:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70940fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197418.241713:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776255104 00000100:00100000:3.0:1788197418.241719:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776255104 00000100:00100000:3.0:1788197418.241757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788197418.241766:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776255104:12345-0@lo:502: 00000100:00100000:3.0:1788197418.242415:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776255104:12345-0@lo:502: Request processed in 648us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.242423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788197418.242556:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708388380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255104:0@lo:502: 00000040:00080000:1.0:1788197418.242665:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788197418.242677:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788197418.244238:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788197418.244251:0:7652:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788197418.244258:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197418.244260:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788197418.244266:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788197418.244283:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93c73cfbb370) 00000020:00000080:1.0:1788197418.244375:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788197418.244384:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788197418.244470:0:7652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c736929000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788197418.244477:0:7652:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788197418.244493:0:7652:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x167e6c292402fee8 00010000:00010000:1.0:1788197418.260130:0:7652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788197418.260478:0:7652:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788197418.273635:0:7652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788197418.275484:0:7652:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788197418.292543:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788197418.294481:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788197418.298728:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788197418.298741:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197418.298748:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197418.298750:0:7652:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788197418.298754:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197418.298757:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197418.298759:0:7652:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788197418.298761:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788197418.298763:0:7652:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788197418.298856:0:7652:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197418.298860:0:7652:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197418.298861:0:7652:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788197418.298864:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788197418.299471:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788197418.299500:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788197418.299530:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.299542:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197418.299550:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c736929000 from 1 10000000:01000000:3.0:1788197418.299553:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788197418.299593:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.299601:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.299628:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.299651:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255232:0@lo:101: 00000100:00100000:3.0:1788197418.299722:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.299792:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788197418.299925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776255232 00000100:00100000:1.0:1788197418.299934:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776255232 00000100:00100000:1.0:1788197418.300003:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788197418.300014:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:7645:x1875060776255232:12345-0@lo:101: 00010000:00010000:1.0:1788197418.300028:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197418.300040:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402feef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197418.300066:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402feef expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197418.300076:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402feef expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197418.300092:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386600, rc 0) 00000100:00100000:1.0:1788197418.300134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255232:12345-0@lo:101: Request processed in 122us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.300141:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788197418.301885:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255232:0@lo:101: 00010000:00010000:3.0:1788197418.301914:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.301926:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.302135:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255360:0@lo:501: 00000100:00100000:3.0:1788197418.302607:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.302686:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788197418.307635:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776255360 00000100:00100000:2.0:1788197418.307650:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776255360 00000100:00100000:2.0:1788197418.307724:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788197418.307736:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255360:12345-0@lo:501: 00000100:00100000:2.0:1788197418.308548:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255360:12345-0@lo:501: Request processed in 811us (5938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197418.308559:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788197418.310543:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255360:0@lo:501: 00000100:00100000:0.0:1788197418.310605:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255488:0@lo:503: 00000100:00100000:0.0:1788197418.310682:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.310726:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73bbab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197418.310856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776255488 00000100:00100000:1.0:1788197418.310866:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776255488 00000100:00100000:1.0:1788197418.310925:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788197418.310936:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255488:12345-0@lo:503: 00000100:00100000:1.0:1788197418.311714:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255488:12345-0@lo:503: Request processed in 775us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.311723:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788197418.311853:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255488:0@lo:503: 00000040:00080000:2.0:1788197418.312178:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788197418.312256:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255616:0@lo:502: 00000100:00100000:2.0:1788197418.312318:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197418.312358:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706655e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197418.312727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776255616 00000100:00100000:1.0:1788197418.312735:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776255616 00000100:00100000:1.0:1788197418.312769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788197418.312777:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255616:12345-0@lo:502: 00000100:00100000:1.0:1788197418.313159:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255616:12345-0@lo:502: Request processed in 381us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.313239:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788197418.313736:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255616:0@lo:502: 00000040:00080000:2.0:1788197418.314593:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788197418.314661:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788197418.314706:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255744:0@lo:502: 00000100:00100000:2.0:1788197418.314770:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197418.315372:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706655e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197418.316150:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776255744 00000100:00100000:0.0:1788197418.316161:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776255744 00000100:00100000:0.0:1788197418.316348:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788197418.316360:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255744:12345-0@lo:502: 00000100:00100000:0.0:1788197418.316681:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255744:12345-0@lo:502: Request processed in 323us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.316689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788197418.317237:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255744:0@lo:502: 00000040:00080000:2.0:1788197418.317375:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788197418.317390:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788197418.318383:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788197418.318394:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197418.318396:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788197418.318402:0:7656:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c736929000 00000020:00000080:0.0:1788197418.318404:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788197418.318420:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197418.318423:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197418.318425:0:7656:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788197418.318427:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788197418.318673:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788197418.318697:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788197418.318719:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.318731:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197418.318771:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788197418.318774:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c736929000 10000000:01000000:2.0:1788197418.318777:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c736929000 10000000:01000000:2.0:1788197418.318781:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788197418.318798:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c736929000 from 1 10000000:01000000:2.0:1788197418.318801:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788197418.318864:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.318873:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.318893:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197418.318915:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255872:0@lo:101: 00000100:00100000:2.0:1788197418.319315:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197418.319362:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706655b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197418.319412:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776255872 00000100:00100000:0.0:1788197418.319421:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776255872 00000100:00100000:0.0:1788197418.319475:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788197418.319486:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776255872:12345-0@lo:101: 00010000:00010000:0.0:1788197418.319500:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197418.319536:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fefd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.319560:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fefd expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.319570:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fefd expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.319579:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030400, rc 0) 00000100:00100000:0.0:1788197418.319625:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776255872:12345-0@lo:101: Request processed in 140us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.319633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788197418.321988:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776255872:0@lo:101: 00010000:00010000:3.0:1788197418.322019:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.322031:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.322180:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256000:0@lo:501: 00000100:00100000:3.0:1788197418.322419:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.322460:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197418.322552:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256000 00000100:00100000:0.0:1788197418.322560:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256000 00000100:00100000:0.0:1788197418.322615:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788197418.322625:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256000:12345-0@lo:501: 00000100:00100000:0.0:1788197418.323220:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256000:12345-0@lo:501: Request processed in 594us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.323229:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788197418.325062:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256000:0@lo:501: 00000100:00100000:3.0:1788197418.325139:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256128:0@lo:503: 00000100:00100000:3.0:1788197418.325220:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.325272:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197418.325455:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256128 00000100:00100000:2.0:1788197418.325463:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256128 00000100:00100000:2.0:1788197418.325539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788197418.325550:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256128:12345-0@lo:503: 00000100:00100000:2.0:1788197418.325762:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256128:12345-0@lo:503: Request processed in 213us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197418.325769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788197418.326020:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256128:0@lo:503: 00000040:00080000:3.0:1788197418.326777:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788197418.328903:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256256:0@lo:502: 00000100:00100000:3.0:1788197418.329024:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.329072:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197418.329139:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256256 00000100:00100000:0.0:1788197418.329149:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256256 00000100:00100000:0.0:1788197418.329213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788197418.329224:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256256:12345-0@lo:502: 00000100:00100000:0.0:1788197418.329549:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256256:12345-0@lo:502: Request processed in 325us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.329558:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788197418.329731:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256256:0@lo:502: 00000040:00080000:3.0:1788197418.331800:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788197418.331918:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788197418.331949:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788197418.332718:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788197418.332769:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788197418.332872:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788197418.333070:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788197418.333814:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788197418.333952:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788197418.333992:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788197418.334048:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788197418.334777:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788197418.334813:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788197418.334876:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788197418.334934:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788197418.334967:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788197418.335001:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788197418.335048:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788197418.335085:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788197418.335150:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788197418.335625:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788197418.335671:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788197418.335707:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788197418.335757:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788197418.335794:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788197418.335876:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788197418.335964:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788197418.336002:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788197418.336036:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788197418.336099:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788197418.336138:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788197418.336169:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788197418.336203:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788197418.337683:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788197418.337789:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788197418.337872:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788197418.337984:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788197418.338041:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256384:0@lo:502: 00000100:00100000:3.0:1788197418.338589:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197418.342139:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256384 00000100:00100000:1.0:1788197418.342163:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256384 00000100:00100000:1.0:1788197418.342258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788197418.342271:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256384:12345-0@lo:502: 00000100:00100000:1.0:1788197418.342610:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776256384:12345-0@lo:502: Request processed in 340us (4022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.342618:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788197418.343001:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197418.343031:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776256384:0@lo:502: 00000040:00080000:2.0:1788197418.343182:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788197418.343202:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788197418.345685:0:7657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788197418.345706:0:7657:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93c73cff19b8) 00000020:00000080:2.0:1788197418.345736:0:7657:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788197418.346300:0:7657:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c736929000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788197418.346307:0:7657:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c736929000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788197418.346310:0:7657:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c736929000 3 00010000:00080000:2.0:1788197418.346363:0:7657:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c737236000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.140@tcp at head 00010000:00010000:2.0:1788197418.351670:0:7657:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788197418.352014:0:7657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788197418.352058:0:7657:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788197418.352078:0:7657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x167e6c292402ff12 00000100:00080000:2.0:1788197418.352089:0:7657:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788197418.352094:0:7657:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c737236000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1788197418.352133:0:7657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c2e1f80 x1875060776256512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788197418.353352:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875060776256512:0@lo:38: 00000100:00100000:1.0:1788197418.353441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788197418.353540:0:7657:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1788197418.353796:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1788197418.353996:0:7658:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff93c73c2e1c00 x1875060776256640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197418.354007:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706655780 going to sleep for 0 seconds 00000100:00100000:3.0:1788197418.355489:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256512 00000100:00100000:3.0:1788197418.355506:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256512 00000100:00100000:3.0:1788197418.355573:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197418.355583:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1875060776256512:12345-0@lo:38: 00010000:00080000:3.0:1788197418.355620:0:5871:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1788197418.355654:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x167e6c292402ff19 00000004:00100000:3.0:1788197418.355669:0:5871:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788197418.355700:0:5871:0:(import.c:65:import_set_state_nolock()) ffff93c741702000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788197418.360591:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776256768:0@lo:400: 00000100:00100000:0.0:1788197418.360668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.360706:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197418.360713:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776256896:0@lo:400: 00000100:00100000:0.0:1788197418.360735:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.360764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776257024:0@lo:400: 00000100:00100000:0.0:1788197418.360935:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.360981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256768 00000100:00100000:0.0:1788197418.360988:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256768 00000100:00100000:0.0:1788197418.361027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256896 00000100:00100000:0.0:1788197418.361030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256896 00000100:00100000:0.0:1788197418.361052:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788197418.361060:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776256768:12345-0@lo:400: 00000100:00100000:0.0:1788197418.361111:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776256768:12345-0@lo:400: Request processed in 51us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.361119:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788197418.361136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788197418.361142:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776256896:12345-0@lo:400: 00000100:00100000:0.0:1788197418.361404:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776256896:12345-0@lo:400: Request processed in 260us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.361412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788197418.361438:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257024 00000100:00100000:0.0:1788197418.361442:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257024 00000100:00100000:0.0:1788197418.361471:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788197418.361477:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776257024:12345-0@lo:400: 00000100:00100000:0.0:1788197418.361527:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776257024:12345-0@lo:400: Request processed in 38us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.361533:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788197418.361559:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197418.361563:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788197418.361594:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c707c02a00 x1875060776256896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197418.361608:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776256896:0@lo:400: 00010000:00080000:0.0:1788197418.361619:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c707c00a80 x1875060776256768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197418.361627:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776256768:0@lo:400: 00010000:00080000:0.0:1788197418.361655:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c707c01c00 x1875060776257024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197418.361663:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776257024:0@lo:400: 00000020:01000000:0.0:1788197418.361695:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788197418.361727:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788197418.361742:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.361752:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788197418.361987:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788197418.361990:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788197418.361991:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197418.361993:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197418.361994:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197418.361996:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197418.361997:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197418.361998:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788197418.361999:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788197418.362001:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197418.362002:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788197418.362010:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788197418.362013:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788197418.362014:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788197418.362015:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197418.362016:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197418.362017:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197418.362018:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197418.362019:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197418.362020:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788197418.362021:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788197418.362022:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197418.362023:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788197418.362039:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788197418.362051:0:7645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776257152:0@lo:253: 00000100:00100000:0.0:1788197418.362102:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197418.362130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257152 00000100:00100000:0.0:1788197418.362134:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257152 00000100:00100000:0.0:1788197418.362162:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788197418.362182:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:7645:x1875060776257152:12345-0@lo:253: 20000000:01000000:0.0:1788197418.362213:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788197418.362227:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788197418.363904:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7186e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788197418.365796:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875060776256512:12345-0@lo:38: Request processed in 10200us (12342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197418.365838:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788197418.367770:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e1f80 x1875060776256512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788197428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197418.367801:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788197418.367814:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788197418.367846:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788197418.367853:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788197418.367857:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c737236000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788197418.367866:0:3310:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000001ca7896d): req@ffff93c73c2e1c00 x1875060776256640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197418.367884:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875060776256512:0@lo:38: 00000100:00100000:2.0:1788197418.370150:0:7658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197418.370268:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776256640 00000100:00100000:1.0:1788197418.370276:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776256640 00000100:00100000:1.0:1788197418.370349:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197418.370359:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1875060776256640:12345-0@lo:901: 00000100:00080000:3.0:1788197418.370453:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197418.376364:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1875060776256640:12345-0@lo:901: Request processed in 5994us (6209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.376380:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788197418.377354:0:7658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c2e1c00 x1875060776256640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788197434 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197418.377374:0:7658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7658:1875060776256640:0@lo:901: 20000000:01000000:2.0:1788197418.435081:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788197418.435104:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788197418.435171:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788197418.435178:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788197418.435207:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.435227:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe6a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.435249:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.435307:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fe6a expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.435323:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fe6a expref: 14 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.435338:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875060776257280:0@lo:104: 00000100:00100000:3.0:1788197418.435416:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197418.435490:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197418.435610:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257280 00000100:00100000:0.0:1788197418.435620:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257280 00000100:00100000:0.0:1788197418.435684:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788197418.435696:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5857:x1875060776257280:12345-0@lo:104: 00010000:00010000:0.0:1788197418.435711:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.435776:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788197418.435782:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:5857:x1875060776257280:12345-0@lo:104: Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197418.435789:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788197418.435881:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1875060776257280:0@lo:104: 00010000:00010000:2.0:1788197418.435900:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.436061:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197418.436067:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.436075:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742142600 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197418.436078:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.436106:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197418.436113:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197418.436119:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788197418.436157:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.436162:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197418.436186:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.436193:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742142600/0x167e6c292402fe6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe71 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197418.436210:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.436211:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197418.436213:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197418.436221:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788197418.436232:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776257408:0@lo:103: 00000100:00100000:3.0:1788197418.436494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197418.436880:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257408 00000100:00100000:2.0:1788197418.436887:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257408 00010000:00010000:2.0:1788197418.436911:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe6a expref: 15 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197418.436935:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788197418.436943:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7066c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:3313:x1875060776257408:12345-0@lo:103: 00010000:00010000:2.0:1788197418.436964:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197418.436978:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe6a expref: 15 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.436989:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fe6a expref: 15 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437003:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143a00/0x167e6c292402fe71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fe6a expref: 15 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437016:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437025:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788197418.437037:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003273255s 00010000:00010000:2.0:1788197418.437041:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437048:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437053:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437059:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437064:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197418.437068:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437074:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437099:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197418.437108:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197418.437145:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7066c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3313:x1875060776257408:12345-0@lo:103: Request processed in 202us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197418.437151:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788197418.437256:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.437264:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197418.437269:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197418.437674:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776257408:0@lo:103: 00000100:00100000:1.0:1788197418.455470:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:7645:x1875060776257152:12345-0@lo:253: Request processed in 93292us (93358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197418.455485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788197418.455599:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3d1c03da-de40-4aeb-8e95-9670c13aad9c:7645:1875060776257152:0@lo:253: 10000000:01000000:0.0:1788197418.455615:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788197418.455619:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788197418.455620:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788197418.455622:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197418.455623:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197418.455625:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197418.455626:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197418.455627:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197418.455629:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788197418.455630:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788197418.455632:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197418.455634:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788197418.455648:0:7645:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788197418.473025:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788197418.474863:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788197418.475151:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197418.475978:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788197418.476232:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788197418.476755:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788197418.477943:0:7645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788197418.607074:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788197418.784473:0:7645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788197418.784486:0:7645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788197418.784540:0:7645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788197418.784629:0:7645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788197418.784646:0:7645:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788197418.784692:0:7645:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788197419.632875:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197420.653954:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197421.689199:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197421.934709:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197421.934734:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776257536:0@lo:13: 00000100:00100000:3.0:1788197421.934849:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197421.935143:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257536 00000100:00100000:2.0:1788197421.935222:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257536 00000100:00100000:2.0:1788197421.935357:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788197421.935368:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776257536:12345-0@lo:13: 00002000:00000024:2.0:1788197421.935401:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197421.935452:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776257536:12345-0@lo:13: Request processed in 87us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197421.935460:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788197421.935510:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e1c00 x1875060776257536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197421.935528:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776257536:0@lo:13: 00000100:00080000:3.0:1788197421.935627:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788197422.703250:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197423.473377:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776257792:0@lo:400: 00000100:00100000:1.0:1788197423.473454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197423.473525:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197423.473532:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776257920:0@lo:400: 00000100:00100000:1.0:1788197423.473570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197423.473622:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257792 00000100:00100000:1.0:1788197423.473630:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257792 00000100:00100000:1.0:1788197423.473680:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257920 00000100:00100000:1.0:1788197423.473683:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257920 00000100:00100000:1.0:1788197423.473719:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788197423.473728:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776257792:12345-0@lo:400: 00000100:00100000:1.0:1788197423.473780:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776257792:12345-0@lo:400: Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197423.473787:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788197423.473804:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788197423.473810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776257920:12345-0@lo:400: 00000100:00100000:1.0:1788197423.473857:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776257920:12345-0@lo:400: Request processed in 47us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197423.473863:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788197423.473899:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788197423.473934:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70838b480 x1875060776257920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197423.473951:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776257920:0@lo:400: 00010000:00080000:1.0:1788197423.473963:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c708389180 x1875060776257792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197423.473972:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776257792:0@lo:400: 00000100:00100000:1.0:1788197423.474013:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776258048:0@lo:400: 00000100:00100000:1.0:1788197423.474042:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197423.474068:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788197423.474075:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776257664:0@lo:400: 00000100:00100000:1.0:1788197423.474103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197423.474134:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776258176:0@lo:400: 00000100:00100000:1.0:1788197423.474155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197423.474176:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258048 00000100:00100000:1.0:1788197423.474180:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258048 00000100:00100000:1.0:1788197423.474211:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197423.474217:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776258048:12345-0@lo:400: 00000100:00100000:1.0:1788197423.474249:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776258048:12345-0@lo:400: Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197423.474255:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788197423.474270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788197423.474284:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70838a680 x1875060776258048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197423.474293:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776258048:0@lo:400: 00000100:00100000:1.0:1788197423.474309:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258176 00000100:00100000:1.0:1788197423.474312:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258176 00000100:00100000:1.0:1788197423.474337:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788197423.474343:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776258176:12345-0@lo:400: 00000100:00100000:1.0:1788197423.474374:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776258176:12345-0@lo:400: Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197423.474379:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788197423.474392:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788197423.474406:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c708389880 x1875060776258176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197423.474414:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776258176:0@lo:400: 00000100:00100000:1.0:1788197423.474437:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776257664 00000100:00100000:1.0:1788197423.474440:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776257664 00000100:00100000:1.0:1788197423.474462:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788197423.474475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3311:x1875060776257664:12345-0@lo:400: 00000100:00100000:1.0:1788197423.474521:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3311:x1875060776257664:12345-0@lo:400: Request processed in 47us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197423.474527:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788197423.474560:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776257664:0@lo:400: 00010000:00010000:3.0:1788197423.727034:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197424.749939:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197425.777926:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788197425.904712:0:8001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788197426.043034:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788197426.043041:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c70f634000 from 30 10000000:01000000:3.0:1788197426.043046:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788197426.043089:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.043100:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.043121:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197426.043140:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258304:0@lo:101: 00000100:00100000:3.0:1788197426.043193:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.043243:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.043299:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258304 00000100:00100000:1.0:1788197426.043307:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258304 00000100:00100000:1.0:1788197426.043367:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788197426.043378:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776258304:12345-0@lo:101: 00010000:00010000:1.0:1788197426.043389:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197426.043402:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402ff27 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197426.043427:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402ff27 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197426.043437:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff27 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197426.043447:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386000, rc 0) 00000100:00100000:1.0:1788197426.043508:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776258304:12345-0@lo:101: Request processed in 133us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197426.043515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788197426.043670:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258304:0@lo:101: 00010000:00010000:3.0:1788197426.043685:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.043694:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197426.043742:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258432:0@lo:501: 00000100:00100000:3.0:1788197426.043776:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.043797:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.043915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258432 00000100:00100000:1.0:1788197426.043920:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258432 00000100:00100000:1.0:1788197426.043951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788197426.043959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776258432:12345-0@lo:501: 00000100:00100000:1.0:1788197426.044323:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776258432:12345-0@lo:501: Request processed in 364us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197426.044330:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788197426.044578:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258432:0@lo:501: 00000100:00100000:0.0:1788197426.044610:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258560:0@lo:503: 00000100:00100000:0.0:1788197426.044655:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197426.044688:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73bbab600 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.045977:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258560 00000100:00100000:1.0:1788197426.045988:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258560 00000100:00100000:1.0:1788197426.046040:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788197426.046050:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776258560:12345-0@lo:503: 00000100:00100000:1.0:1788197426.046570:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776258560:12345-0@lo:503: Request processed in 520us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197426.046578:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788197426.046636:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258560:0@lo:503: 00000100:00100000:3.0:1788197426.048156:0:8011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8011:1875060776258688:0@lo:502: 00000100:00100000:3.0:1788197426.048213:0:8011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.048250:0:8011:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197426.048612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258688 00000100:00100000:0.0:1788197426.048618:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258688 00000100:00100000:0.0:1788197426.048661:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788197426.048671:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8011:x1875060776258688:12345-0@lo:502: 00000100:00100000:0.0:1788197426.049007:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8011:x1875060776258688:12345-0@lo:502: Request processed in 337us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.049015:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788197426.050255:0:8011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8011:1875060776258688:0@lo:502: 00000100:00100000:3.0:1788197426.050321:0:8011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8011:1875060776258816:0@lo:502: 00000100:00100000:3.0:1788197426.050376:0:8011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.050414:0:8011:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.050432:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258816 00000100:00100000:1.0:1788197426.050438:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258816 00000100:00100000:1.0:1788197426.050492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788197426.050499:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8011:x1875060776258816:12345-0@lo:502: 00000100:00100000:1.0:1788197426.050707:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8011:x1875060776258816:12345-0@lo:502: Request processed in 208us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197426.050714:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788197426.056146:0:8011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8011:1875060776258816:0@lo:502: 00000040:00080000:3.0:1788197426.056189:0:8011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788197426.061452:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788197426.061505:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788197426.061517:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197426.061529:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197426.061538:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788197426.061554:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788197426.061557:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788197426.061592:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197426.061599:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197426.061610:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197426.061634:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258944:0@lo:101: 00000100:00100000:1.0:1788197426.061719:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197426.063334:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737077e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.064235:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776258944 00000100:00100000:3.0:1788197426.064246:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776258944 00000100:00100000:3.0:1788197426.064306:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788197426.064316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776258944:12345-0@lo:101: 00010000:00010000:3.0:1788197426.064334:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197426.064353:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402ff35 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.064382:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402ff35 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.064393:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff35 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.064403:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6800, rc 0) 00000100:00100000:3.0:1788197426.064498:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776258944:12345-0@lo:101: Request processed in 183us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.064514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788197426.065452:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776258944:0@lo:101: 00010000:00010000:2.0:1788197426.065494:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197426.065505:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197426.065574:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259072:0@lo:501: 00000100:00100000:2.0:1788197426.065620:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197426.065662:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197426.065863:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259072 00000100:00100000:0.0:1788197426.065870:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259072 00000100:00100000:0.0:1788197426.065911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788197426.065919:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776259072:12345-0@lo:501: 00000100:00100000:0.0:1788197426.066212:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776259072:12345-0@lo:501: Request processed in 292us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.066219:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788197426.066378:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259072:0@lo:501: 00000100:00100000:2.0:1788197426.066412:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259200:0@lo:503: 00000100:00100000:2.0:1788197426.066539:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197426.066617:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.068536:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259200 00000100:00100000:1.0:1788197426.068551:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259200 00000100:00100000:1.0:1788197426.068595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788197426.068604:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776259200:12345-0@lo:503: 00000100:00100000:1.0:1788197426.073004:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776259200:12345-0@lo:503: Request processed in 4388us (6452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197426.073021:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788197426.074538:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259200:0@lo:503: 00000100:00100000:1.0:1788197426.075436:0:8014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8014:1875060776259328:0@lo:502: 00000100:00100000:1.0:1788197426.075524:0:8014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197426.075569:0:8014:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737077cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197426.075699:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259328 00000100:00100000:2.0:1788197426.075707:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259328 00000100:00100000:2.0:1788197426.075752:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788197426.075761:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8014:x1875060776259328:12345-0@lo:502: 00000100:00100000:2.0:1788197426.076531:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8014:x1875060776259328:12345-0@lo:502: Request processed in 766us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197426.076540:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788197426.077128:0:8014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8014:1875060776259328:0@lo:502: 00000020:01000000:1.0:1788197426.077162:0:8014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788197426.077170:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197426.077173:0:8014:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788197426.077177:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788197426.077187:0:8014:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788197426.077216:0:8014:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8014:1875060776259456:0@lo:502: 00000100:00100000:1.0:1788197426.077407:0:8014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197426.077439:0:8014:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737077cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.077511:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259456 00000100:00100000:3.0:1788197426.077518:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259456 00000100:00100000:3.0:1788197426.077593:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788197426.077602:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8014:x1875060776259456:12345-0@lo:502: 00000100:00100000:3.0:1788197426.077800:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8014:x1875060776259456:12345-0@lo:502: Request processed in 198us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.077808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788197426.078018:0:8014:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8014:1875060776259456:0@lo:502: 00000020:01000000:2.0:1788197426.078039:0:8014:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197426.078044:0:8014:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197426.078046:0:8014:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788197426.078049:0:8014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788197426.078107:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788197426.078123:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788197426.078132:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197426.078143:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197426.078153:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788197426.078155:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c706bce800 from 30 10000000:01000000:2.0:1788197426.078158:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788197426.078182:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197426.078190:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197426.078198:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197426.078211:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259584:0@lo:101: 00000100:00100000:2.0:1788197426.078238:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197426.079495:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259584 00000100:00100000:0.0:1788197426.079507:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259584 00000100:00100000:0.0:1788197426.079558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788197426.079566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776259584:12345-0@lo:101: 00010000:00010000:0.0:1788197426.079583:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197426.079713:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402ff43 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.079740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402ff43 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.079751:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff43 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.079768:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030e00, rc 0) 00000100:00100000:0.0:1788197426.080277:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776259584:12345-0@lo:101: Request processed in 254us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.080288:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788197426.080517:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788197426.080537:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259584:0@lo:101: 00010000:00010000:2.0:1788197426.080554:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197426.080563:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197426.080644:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259712:0@lo:501: 00000100:00100000:2.0:1788197426.080685:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197426.080705:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788197426.080812:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259712 00000100:00100000:0.0:1788197426.080817:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259712 00000100:00100000:0.0:1788197426.080872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788197426.080879:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776259712:12345-0@lo:501: 00000100:00100000:0.0:1788197426.081316:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776259712:12345-0@lo:501: Request processed in 436us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.081324:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788197426.083150:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259712:0@lo:501: 00000100:00100000:1.0:1788197426.083199:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259840:0@lo:503: 00000100:00100000:1.0:1788197426.083255:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197426.083297:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737077900 going to sleep for 11 seconds 00000100:00100000:0.0:1788197426.083347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259840 00000100:00100000:0.0:1788197426.083353:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259840 00000100:00100000:0.0:1788197426.083397:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788197426.083406:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776259840:12345-0@lo:503: 00000100:00100000:0.0:1788197426.083580:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776259840:12345-0@lo:503: Request processed in 174us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.083587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788197426.086333:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776259840:0@lo:503: 00000100:00100000:2.0:1788197426.090150:0:8016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8016:1875060776259968:0@lo:502: 00000100:00100000:2.0:1788197426.090225:0:8016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197426.090369:0:8016:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197426.090403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776259968 00000100:00100000:0.0:1788197426.090411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776259968 00000100:00100000:0.0:1788197426.090492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788197426.090501:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8016:x1875060776259968:12345-0@lo:502: 00000100:00100000:0.0:1788197426.090765:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8016:x1875060776259968:12345-0@lo:502: Request processed in 264us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.090773:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788197426.090899:0:8016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8016:1875060776259968:0@lo:502: 00000100:00100000:3.0:1788197426.090952:0:8016:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8016:1875060776260096:0@lo:502: 00000100:00100000:3.0:1788197426.091056:0:8016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.091115:0:8016:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788197426.091174:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260096 00000100:00100000:0.0:1788197426.091179:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260096 00000100:00100000:0.0:1788197426.091211:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788197426.091218:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8016:x1875060776260096:12345-0@lo:502: 00000100:00100000:0.0:1788197426.091490:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8016:x1875060776260096:12345-0@lo:502: Request processed in 271us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.091497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788197426.091571:0:8016:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8016:1875060776260096:0@lo:502: 00000040:00080000:3.0:1788197426.091593:0:8016:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788197426.091728:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788197426.091748:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788197426.091758:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.091770:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197426.091780:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788197426.091784:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c706bce800 from 5 10000000:01000000:0.0:1788197426.091786:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788197426.091815:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.091899:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.091909:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197426.091925:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260224:0@lo:101: 00000100:00100000:0.0:1788197426.091959:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197426.092073:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7053bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.092127:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260224 00000100:00100000:3.0:1788197426.092133:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260224 00000100:00100000:3.0:1788197426.092194:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788197426.092203:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776260224:12345-0@lo:101: 00010000:00010000:3.0:1788197426.092212:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197426.092225:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6400/0x167e6c292402ff58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402ff51 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092245:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6400/0x167e6c292402ff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402ff51 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092266:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6400/0x167e6c292402ff58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff51 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092281:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6400, rc 0) 00000100:00100000:3.0:1788197426.092311:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776260224:12345-0@lo:101: Request processed in 110us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.092317:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788197426.092344:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260224:0@lo:101: 00010000:00010000:3.0:1788197426.092354:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092362:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197426.092400:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260352:0@lo:256: 00000100:00100000:3.0:1788197426.092428:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.092444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260352 00000100:00100000:3.0:1788197426.092447:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260352 00000100:00100000:3.0:1788197426.092462:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788197426.092467:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776260352:12345-0@lo:256: 20000000:01000000:3.0:1788197426.092490:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788197426.092505:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788197426.092508:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788197426.092568:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776260352:12345-0@lo:256: Request processed in 100us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.092575:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788197426.092594:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.092605:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260352:0@lo:256: 10000000:01000000:3.0:1788197426.092639:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788197426.092647:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092654:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197426.092662:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788197426.092664:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788197426.092666:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788197426.092680:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092686:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092693:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197426.092705:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260480:0@lo:101: 00000100:00100000:3.0:1788197426.092726:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.092744:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260480 00000100:00100000:3.0:1788197426.092747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260480 00000100:00100000:3.0:1788197426.092763:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788197426.092768:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776260480:12345-0@lo:101: 00010000:00010000:3.0:1788197426.092775:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197426.092781:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402ff5f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092793:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402ff5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092812:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092818:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7e00, rc 0) 00000100:00100000:3.0:1788197426.092859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776260480:12345-0@lo:101: Request processed in 90us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.092865:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788197426.092885:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.092895:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260480:0@lo:101: 00010000:00010000:3.0:1788197426.092906:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.092913:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197426.092950:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260608:0@lo:501: 00000100:00100000:3.0:1788197426.093101:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.093118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260608 00000100:00100000:3.0:1788197426.093122:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260608 00000100:00100000:3.0:1788197426.093137:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788197426.093142:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776260608:12345-0@lo:501: 00000100:00100000:3.0:1788197426.093412:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776260608:12345-0@lo:501: Request processed in 269us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.093419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788197426.093440:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.093450:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260608:0@lo:501: 00000100:00100000:3.0:1788197426.093491:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260736:0@lo:503: 00000100:00100000:3.0:1788197426.093526:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.093545:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260736 00000100:00100000:3.0:1788197426.093549:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260736 00000100:00100000:3.0:1788197426.093566:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788197426.093572:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776260736:12345-0@lo:503: 00000100:00100000:3.0:1788197426.093845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776260736:12345-0@lo:503: Request processed in 272us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.093852:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788197426.093879:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.093891:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776260736:0@lo:503: 00000100:00100000:3.0:1788197426.094605:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8018:1875060776260864:0@lo:502: 00000100:00100000:3.0:1788197426.094652:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.094722:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197426.094753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260864 00000100:00100000:2.0:1788197426.094758:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260864 00000100:00100000:2.0:1788197426.094851:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788197426.094860:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8018:x1875060776260864:12345-0@lo:502: 00000100:00100000:2.0:1788197426.095205:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8018:x1875060776260864:12345-0@lo:502: Request processed in 346us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197426.095212:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788197426.095306:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8018:1875060776260864:0@lo:502: 00000020:01000000:0.0:1788197426.095332:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788197426.095340:0:8018:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788197426.095346:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197426.095349:0:8018:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788197426.095356:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788197426.095360:0:8018:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000020:01000000:0.0:1788197426.095380:0:8018:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788197426.095383:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788197426.095397:0:8018:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93c706238000) 00000020:00000080:0.0:1788197426.095415:0:8018:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788197426.095421:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788197426.095501:0:8018:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788197426.095506:0:8018:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788197426.095512:0:8018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292402ff74 00010000:00080000:0.0:1788197426.095537:0:8018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c736af5000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:0.0:1788197426.095747:0:8018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788197426.096185:0:8018:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788197426.096195:0:8018:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788197426.096668:0:8018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197426.096893:0:8018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197426.096941:0:8018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788197426.097207:0:8018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788197426.097766:0:8019:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788197426.097771:0:8019:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788197426.098671:0:8018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788197426.098683:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788197426.098716:0:8018:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788197426.098738:0:8018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c292402ff7b 00000100:00080000:0.0:1788197426.098748:0:8018:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788197426.098754:0:8018:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c736af5000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1788197426.098793:0:8018:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c707c02a00 x1875060776260992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788197426.098867:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776260992:0@lo:8: 00000100:00100000:2.0:1788197426.098944:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.099055:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776260992 00000100:00100000:3.0:1788197426.099062:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776260992 00000100:00100000:3.0:1788197426.099093:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197426.099100:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1875060776260992:12345-0@lo:8: 00010000:00080000:3.0:1788197426.099125:0:6699:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1788197426.099161:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c292402ff82 00002000:00100000:3.0:1788197426.099176:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93c706743800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788197426.099180:0:6699:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788197426.099185:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788197426.099301:0:6699:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788197426.099442:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788197426.099482:0:6699:0:(import.c:65:import_set_state_nolock()) ffff93c706743000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788197426.099721:0:8018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788197426.099790:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776261120:0@lo:400: 00000020:01000000:0.0:1788197426.099882:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197426.099888:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197426.099890:0:8018:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788197426.099893:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788197426.099897:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197426.099898:0:8018:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788197426.099901:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788197426.099903:0:8018:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788197426.099933:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8018:1875060776261632:0@lo:502: 00000100:00100000:1.0:1788197426.100014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197426.101511:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197426.101528:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197426.101539:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776261248:0@lo:400: 00000100:00100000:0.0:1788197426.101550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776261632 00000100:00100000:0.0:1788197426.101557:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776261632 00000100:00100000:1.0:1788197426.101591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197426.101594:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788197426.101602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8018:x1875060776261632:12345-0@lo:502: 00000100:00100000:1.0:1788197426.101626:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776261376:0@lo:400: 00000100:00100000:1.0:1788197426.101652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197426.101669:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197426.101686:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776261504:0@lo:400: 00000100:00100000:1.0:1788197426.101707:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197426.101735:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776261120 00000100:00100000:1.0:1788197426.101739:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776261120 00000100:00100000:1.0:1788197426.101765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776261248 00000100:00100000:1.0:1788197426.101769:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776261248 00000100:00100000:1.0:1788197426.101786:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776261504 00000100:00100000:1.0:1788197426.101788:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776261504 00000100:00100000:1.0:1788197426.101800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788197426.101805:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776261120:12345-0@lo:400: 00000100:00100000:0.0:1788197426.101846:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8018:x1875060776261632:12345-0@lo:502: Request processed in 244us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197426.101854:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788197426.101881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776261120:12345-0@lo:400: Request processed in 69us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197426.101888:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788197426.101897:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741481cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.101902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788197426.101907:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776261248:12345-0@lo:400: 00000100:00100000:0.0:1788197426.101913:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8018:1875060776261632:0@lo:502: 00000020:01000000:0.0:1788197426.101942:0:8018:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197426.101947:0:8018:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197426.101950:0:8018:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788197426.101953:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788197426.102080:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788197426.102094:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788197426.102104:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.102126:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197426.102134:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788197426.102136:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c70623b370 from 1 10000000:01000000:0.0:1788197426.102139:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788197426.102165:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.102173:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197426.102180:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197426.102192:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776261760:0@lo:101: 00000100:00100000:0.0:1788197426.102220:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197426.102238:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741481cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.102435:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776261248:12345-0@lo:400: Request processed in 527us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197426.102443:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788197426.102457:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788197426.102464:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776261504:12345-0@lo:400: 00000100:00100000:3.0:1788197426.102490:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875060776260992:12345-0@lo:8: Request processed in 3387us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.102498:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197426.102513:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776261376 00000100:00100000:1.0:1788197426.102514:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776261504:12345-0@lo:400: Request processed in 52us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.102516:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776261376 00000100:00100000:1.0:1788197426.102520:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788197426.102540:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197426.102546:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776261376:12345-0@lo:400: 00000100:00100000:1.0:1788197426.102550:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788197426.102556:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788197426.102576:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776261376:12345-0@lo:400: Request processed in 31us (923us total) trans 0 rc 0/0 00000100:00080000:1.0:1788197426.102577:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197426.102582:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788197426.102582:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788197426.102602:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c707c00700 x1875060776261248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197426.102614:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776261248:0@lo:400: 00010000:00080000:1.0:1788197426.102624:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c707c02680 x1875060776261120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197426.102631:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776261120:0@lo:400: 00000100:00100000:3.0:1788197426.102713:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776261760 00000100:00100000:3.0:1788197426.102717:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776261760 00000100:00100000:3.0:1788197426.102741:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788197426.102747:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776261760:12345-0@lo:101: 00010000:00010000:3.0:1788197426.102756:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197426.102767:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402ff89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.102786:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402ff89 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.102796:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff89 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.102804:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7a00, rc 0) 00000100:00100000:3.0:1788197426.102855:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776261760:12345-0@lo:101: Request processed in 108us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.102861:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788197426.102899:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776261760:0@lo:101: 00010000:00010000:3.0:1788197426.102910:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.102918:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197426.102960:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776261888:0@lo:501: 00000100:00100000:3.0:1788197426.103059:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.103075:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.103086:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776261888 00000100:00100000:3.0:1788197426.103090:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776261888 00000100:00100000:3.0:1788197426.103110:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788197426.103115:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776261888:12345-0@lo:501: 00000100:00100000:3.0:1788197426.103378:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776261888:12345-0@lo:501: Request processed in 262us (318us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788197426.103386:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788197426.103415:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776261888:0@lo:501: 10000000:01000000:3.0:1788197426.103436:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788197426.103442:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197426.103450:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788197426.103556:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c707c03b80 x1875060776261504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197426.103566:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776261504:0@lo:400: 00010000:00080000:0.0:1788197426.103577:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c707c03480 x1875060776261376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197426.103585:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776261376:0@lo:400: 00010000:00080000:2.0:1788197426.103798:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c707c02a00 x1875060776260992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788197436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197426.103807:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788197426.103814:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788197426.103933:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788197426.103939:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788197426.103943:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c736af5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788197426.104054:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788197426.104067:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776260992:0@lo:8: 00000004:00080000:3.0:1788197426.104121:0:8019:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788197426.104238:0:8019:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 222250414630ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788197426.201218:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788197426.201385:0:8020:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788197426.201430:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262144:0@lo:7: 00000100:00100000:3.0:1788197426.201519:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.201561:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197426.201636:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776262016:0@lo:13: 00000100:00100000:2.0:1788197426.201665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.201683:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262144 00000100:00100000:3.0:1788197426.201691:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262144 00000100:00100000:2.0:1788197426.201719:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262016 00000100:00100000:2.0:1788197426.201722:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262016 00000100:00100000:3.0:1788197426.201742:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197426.201743:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197426.201750:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8020:x1875060776262144:12345-0@lo:7: 00000100:00100000:2.0:1788197426.201750:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776262016:12345-0@lo:13: 00002000:00000024:2.0:1788197426.201778:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788197426.201839:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776262016:12345-0@lo:13: Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197426.201847:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788197426.201882:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480d880 x1875060776262016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197426.201900:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776262016:0@lo:13: 00000100:00080000:1.0:1788197426.202906:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788197426.211212:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788197426.211221:0:6699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788197426.211468:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8020:x1875060776262144:12345-0@lo:7: Request processed in 9714us (9944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.211489:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788197426.212590:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480d180 x1875060776262144/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788197442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197426.212607:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262144:0@lo:7: 00000004:00080000:2.0:1788197426.212624:0:8020:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788197426.213067:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262272:0@lo:5: 00000100:00100000:3.0:1788197426.213120:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.213200:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788197426.213246:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262272 00000100:00100000:1.0:1788197426.213253:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262272 00000100:00100000:1.0:1788197426.213427:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788197426.213437:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8020:x1875060776262272:12345-0@lo:5: 00002000:00080000:1.0:1788197426.213463:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788197426.213467:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788197426.213802:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8020:x1875060776262272:12345-0@lo:5: Request processed in 365us (680us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788197426.213810:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788197426.213900:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480dc00 x1875060776262272/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788197442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197426.213914:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262272:0@lo:5: 00000004:00080000:2.0:1788197426.213924:0:8020:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788197426.213962:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262400:0@lo:700: 00000100:00100000:2.0:1788197426.214002:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197426.214030:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.214150:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262400 00000100:00100000:3.0:1788197426.214155:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262400 00000100:00100000:3.0:1788197426.214194:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197426.214202:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8020:x1875060776262400:12345-0@lo:700: 00000100:00100000:3.0:1788197426.214236:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1875060776262528:0@lo:700: 00000100:00100000:3.0:1788197426.214280:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.214303:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788197426.214317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262528 00000100:00100000:3.0:1788197426.214320:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262528 00000100:00100000:3.0:1788197426.214346:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197426.214353:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1875060776262528:12345-0@lo:700: 40000000:02000000:3.0:1788197426.265180:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788197426.282273:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1875060776262528:12345-0@lo:700: Request processed in 67912us (67984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197426.282288:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788197426.283276:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480ea00 x1875060776262528/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788197442 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197426.283293:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1875060776262528:0@lo:700: 40000000:02000000:1.0:1788197426.283307:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788197426.408243:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788197426.408440:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8020:x1875060776262400:12345-0@lo:700: Request processed in 194234us (194432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197426.408455:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1788197426.408499:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1788197426.408572:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e0a80 x1875060776262400/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788197442 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197426.408583:0:8020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788197426.408599:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262400:0@lo:700: 00000004:02000040:2.0:1788197426.443148:0:8020:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788197426.448202:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262656:0@lo:5: 00000100:00100000:3.0:1788197426.448399:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197426.448545:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7062d59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197426.449038:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262656 00000100:00100000:2.0:1788197426.449048:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262656 00000100:00100000:3.0:1788197426.449236:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788197426.449248:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8020:x1875060776262656:12345-0@lo:5: 00002000:00080000:3.0:1788197426.454405:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788197426.454428:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788197426.458595:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8020:x1875060776262656:12345-0@lo:5: Request processed in 9341us (10189us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788197426.458608:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788197426.458714:0:8020:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480dc00 x1875060776262656/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788197442 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197426.458749:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8020:1875060776262656:0@lo:5: 00000004:00080000:0.0:1788197426.458765:0:8020:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788197426.799774:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197427.054083:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776262784:0@lo:13: 00000100:00100000:1.0:1788197427.054163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197427.054307:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262784 00000100:00100000:2.0:1788197427.054316:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262784 00000100:00100000:2.0:1788197427.054382:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197427.054394:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776262784:12345-0@lo:13: 00002000:00000024:2.0:1788197427.054435:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197427.054499:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776262784:12345-0@lo:13: Request processed in 108us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197427.054506:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788197427.054731:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2680 x1875060776262784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197427.054749:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776262784:0@lo:13: 00010000:00010000:1.0:1788197427.822421:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197428.849966:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197429.870073:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197430.895345:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197431.150191:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776262912:0@lo:400: 00000100:00100000:0.0:1788197431.150286:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197431.150453:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776262912 00000100:00100000:3.0:1788197431.150462:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776262912 00000100:00100000:3.0:1788197431.150519:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788197431.150528:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776262912:12345-0@lo:400: 00000100:00100000:1.0:1788197431.150804:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776263040:0@lo:400: 00000100:00100000:1.0:1788197431.150925:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197431.150981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263040 00000100:00100000:1.0:1788197431.150985:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263040 00000100:00100000:1.0:1788197431.151018:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788197431.151025:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776263040:12345-0@lo:400: 00000100:00100000:1.0:1788197431.151068:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776263040:12345-0@lo:400: Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197431.151091:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788197431.151141:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2680 x1875060776263040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197431.151155:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776263040:0@lo:400: 00000100:00100000:3.0:1788197431.151354:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776262912:12345-0@lo:400: Request processed in 824us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197431.151370:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788197431.151435:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776262912:0@lo:400: 00000100:00100000:0.0:1788197431.151734:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776263168:0@lo:400: 00000100:00100000:0.0:1788197431.151768:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197431.151847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263168 00000100:00100000:1.0:1788197431.151853:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263168 00000100:00100000:1.0:1788197431.151894:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788197431.151903:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776263168:12345-0@lo:400: 00000100:00080000:3.0:1788197431.151970:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197431.152117:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776263296:0@lo:400: 00000100:00100000:3.0:1788197431.152149:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197431.152181:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263296 00000100:00100000:3.0:1788197431.152186:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263296 00000100:00100000:3.0:1788197431.152218:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788197431.152225:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776263296:12345-0@lo:400: 00000100:00100000:3.0:1788197431.152273:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776263296:12345-0@lo:400: Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197431.152280:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788197431.152297:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788197431.152316:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e1c00 x1875060776263296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197431.152327:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776263296:0@lo:400: 00000100:00100000:1.0:1788197431.152486:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776263168:12345-0@lo:400: Request processed in 584us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197431.152493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788197431.152581:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:0.0:1788197431.152665:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e0a80 x1875060776263168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197431.152675:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776263168:0@lo:400: 00000100:00100000:3.0:1788197431.152786:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776263552:0@lo:400: 00000100:00100000:3.0:1788197431.152815:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197431.152866:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776263424:0@lo:400: 00000100:00100000:3.0:1788197431.152887:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197431.152957:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263424 00000100:00100000:1.0:1788197431.152962:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263424 00000100:00100000:1.0:1788197431.153004:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788197431.153011:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776263424:12345-0@lo:400: 00000100:00100000:1.0:1788197431.153047:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776263424:12345-0@lo:400: Request processed in 38us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197431.153053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788197431.153099:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788197431.153119:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e1c00 x1875060776263424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197431.153128:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776263424:0@lo:400: 00000100:00100000:0.0:1788197431.153185:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263552 00000100:00100000:0.0:1788197431.153189:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263552 00000100:00100000:1.0:1788197431.153312:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788197431.153321:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776263552:12345-0@lo:400: 00000100:00100000:1.0:1788197431.153398:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776263552:12345-0@lo:400: Request processed in 79us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197431.153405:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788197431.153459:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788197431.153488:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2300 x1875060776263552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197431.153499:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776263552:0@lo:400: 00000001:00080000:2.0:1788197431.248611:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788197431.670023:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776263680:0@lo:13: 00000100:00100000:1.0:1788197431.670102:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197431.670328:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263680 00000100:00100000:2.0:1788197431.670336:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263680 00000100:00100000:2.0:1788197431.670382:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788197431.670392:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776263680:12345-0@lo:13: 00002000:00000024:2.0:1788197431.670426:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197431.670486:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776263680:12345-0@lo:13: Request processed in 94us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.670493:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788197431.670980:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6066ded80 x1875060776263680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197431.670992:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788197431.671014:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776263680:0@lo:13: 00000100:00100000:2.0:1788197431.754519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197431.754951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755267712 00000100:00100000:3.0:1788197431.754960:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755267712 00000100:00100000:3.0:1788197431.754996:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:3.0:1788197431.755003:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1875060755267712:12345-192.168.206.40@tcp:250: 00010000:00080000:3.0:1788197431.755027:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 05358cfc-7070-4d77-b166-215daa591621@192.168.206.40@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1788197431.755056:0:5833:0:(genops.c:1385:class_connect()) connect: client 05358cfc-7070-4d77-b166-215daa591621, cookie 0x167e6c292402ff97 00000100:00080000:3.0:1788197431.755185:0:5833:0:(import.c:65:import_set_state_nolock()) ffff93c706741800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197431.755641:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+5:2356:x1875060755267712:12345-192.168.206.40@tcp:250: Request processed in 635us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197431.755657:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:2.0:1788197431.765619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197431.765708:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755267840 00000100:00100000:3.0:1788197431.765719:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755267840 00000100:00100000:3.0:1788197431.765788:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:3.0:1788197431.765799:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+5:5586:x1875060755267840:12345-192.168.206.40@tcp:101: 00010000:00010000:3.0:1788197431.765817:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197431.765862:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d560b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197431.765895:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197431.765906:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197431.765927:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7800, rc 0) 00000100:00100000:3.0:1788197431.765996:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+6:5586:x1875060755267840:12345-192.168.206.40@tcp:101: Request processed in 198us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197431.766003:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:3.0:1788197431.777223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197431.777316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755267968 00000100:00100000:1.0:1788197431.777326:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755267968 00000100:00100000:1.0:1788197431.777376:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:1.0:1788197431.777388:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+6:5586:x1875060755267968:12345-192.168.206.40@tcp:501: 00000100:00100000:1.0:1788197431.777800:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+6:5586:x1875060755267968:12345-192.168.206.40@tcp:501: Request processed in 413us (586us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788197431.777809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:0.0:1788197431.788342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197431.790095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268096 00000100:00100000:2.0:1788197431.790109:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268096 00000100:00100000:2.0:1788197431.790170:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:2.0:1788197431.790181:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+6:5586:x1875060755268096:12345-192.168.206.40@tcp:101: 00010000:00010000:2.0:1788197431.790196:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197431.790213:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5612 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197431.790252:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197431.790266:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197431.790276:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142400, rc 0) 00000100:00100000:2.0:1788197431.790338:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+7:5586:x1875060755268096:12345-192.168.206.40@tcp:101: Request processed in 158us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.790345:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:1.0:1788197431.794566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197431.795381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268224 00000100:00100000:2.0:1788197431.795392:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268224 00000100:00100000:2.0:1788197431.795458:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:2.0:1788197431.795469:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+7:5586:x1875060755268224:12345-192.168.206.40@tcp:501: 00000100:00100000:2.0:1788197431.795818:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+8:5586:x1875060755268224:12345-192.168.206.40@tcp:501: Request processed in 349us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.795848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:0.0:1788197431.800703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197431.800888:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268352 00000100:00100000:3.0:1788197431.800900:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268352 00000100:00100000:3.0:1788197431.800959:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:3.0:1788197431.800970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+8:5586:x1875060755268352:12345-192.168.206.40@tcp:503: 00000100:00100000:3.0:1788197431.801356:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+8:5586:x1875060755268352:12345-192.168.206.40@tcp:503: Request processed in 385us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197431.801366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:2.0:1788197431.805950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197431.806201:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268480 00000100:00100000:2.0:1788197431.806210:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268480 00000100:00100000:2.0:1788197431.806283:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:2.0:1788197431.806293:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+8:5605:x1875060755268480:12345-192.168.206.40@tcp:502: 00000100:00100000:2.0:1788197431.806852:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+8:5605:x1875060755268480:12345-192.168.206.40@tcp:502: Request processed in 354us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.806864:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:2.0:1788197431.850026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197431.850154:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268608 00000100:00100000:3.0:1788197431.850164:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268608 00000100:00100000:3.0:1788197431.850217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:3.0:1788197431.850228:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+8:5605:x1875060755268608:12345-192.168.206.40@tcp:502: 00000100:00100000:3.0:1788197431.850511:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+8:5605:x1875060755268608:12345-192.168.206.40@tcp:502: Request processed in 284us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197431.850519:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:2.0:1788197431.856522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197431.857041:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268736 00000100:00100000:3.0:1788197431.857051:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268736 00000100:00100000:3.0:1788197431.857108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:3.0:1788197431.857118:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+8:5586:x1875060755268736:12345-192.168.206.40@tcp:101: 00010000:00010000:3.0:1788197431.857137:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197431.857169:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6c00/0x167e6c292402ffac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d563c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197431.857196:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6c00/0x167e6c292402ffac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d563c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197431.857208:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6c00/0x167e6c292402ffac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d563c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197431.857217:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6c00, rc 0) 00000100:00100000:3.0:1788197431.857382:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+9:5586:x1875060755268736:12345-192.168.206.40@tcp:101: Request processed in 264us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197431.857389:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:2.0:1788197431.861011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197431.861416:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268864 00000100:00100000:0.0:1788197431.861426:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268864 00000100:00100000:0.0:1788197431.861538:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:0.0:1788197431.861548:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+9:5586:x1875060755268864:12345-192.168.206.40@tcp:256: 20000000:01000000:0.0:1788197431.861569:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788197431.861587:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788197431.861591:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788197431.861593:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788197431.861595:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788197431.864532:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+9:5586:x1875060755268864:12345-192.168.206.40@tcp:256: Request processed in 2974us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197431.864556:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:0.0:1788197431.876551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197431.877977:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755268992 00000100:00100000:2.0:1788197431.877991:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755268992 00000100:00100000:2.0:1788197431.878070:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00100000:2.0:1788197431.878082:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+9:5586:x1875060755268992:12345-192.168.206.40@tcp:101: 00010000:00010000:2.0:1788197431.878102:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197431.878123:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5643 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197431.878156:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197431.878167:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197431.878176:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143a00, rc 0) 00000100:00100000:2.0:1788197431.878251:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:5586:x1875060755268992:12345-192.168.206.40@tcp:101: Request processed in 171us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.878258:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00100000:2.0:1788197431.882099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197431.882189:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755269120 00000100:00100000:0.0:1788197431.882199:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755269120 00000100:00100000:0.0:1788197431.882311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:0.0:1788197431.882323:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:5586:x1875060755269120:12345-192.168.206.40@tcp:501: 00000100:00100000:0.0:1788197431.882614:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:5586:x1875060755269120:12345-192.168.206.40@tcp:501: Request processed in 292us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197431.882622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:2.0:1788197431.885425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197431.885677:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755269248 00000100:00100000:0.0:1788197431.885686:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755269248 00000100:00100000:0.0:1788197431.885745:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:0.0:1788197431.885755:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:5586:x1875060755269248:12345-192.168.206.40@tcp:503: 00000100:00100000:0.0:1788197431.886081:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:5586:x1875060755269248:12345-192.168.206.40@tcp:503: Request processed in 326us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197431.886088:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:1.0:1788197431.891186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197431.891259:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755269376 00000100:00100000:2.0:1788197431.891269:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755269376 00000100:00100000:2.0:1788197431.891317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:2.0:1788197431.891328:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:5608:x1875060755269376:12345-192.168.206.40@tcp:502: 00000100:00100000:2.0:1788197431.891587:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:5608:x1875060755269376:12345-192.168.206.40@tcp:502: Request processed in 260us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.891596:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:2.0:1788197431.896260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197431.896291:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755269504 00000100:00100000:2.0:1788197431.896300:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755269504 00000100:00100000:2.0:1788197431.896341:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 127 00000100:00100000:2.0:1788197431.896350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:5608:x1875060755269504:12345-192.168.206.40@tcp:502: 00000100:00100000:2.0:1788197431.896552:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:5608:x1875060755269504:12345-192.168.206.40@tcp:502: Request processed in 202us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.896560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 127 00000100:00100000:1.0:1788197431.903208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197431.903285:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755269632 00000100:00100000:2.0:1788197431.903296:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755269632 00000100:00100000:2.0:1788197431.903344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:2.0:1788197431.903353:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1875060755269632:12345-192.168.206.40@tcp:38: 00010000:00080000:2.0:1788197431.903381:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:2.0:1788197431.903429:0:5843:0:(genops.c:1385:class_connect()) connect: client 87c79f47-cb13-4c8a-942c-8f23eb455b39, cookie 0x167e6c292402ffba 00000004:00100000:2.0:1788197431.903471:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788197431.903477:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788197431.924123:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788197431.939983:0:5843:0:(import.c:65:import_set_state_nolock()) ffff93c737233800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788197431.940054:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2356:x1875060755269632:12345-192.168.206.40@tcp:38: Request processed in 36700us (36855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197431.940080:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:3.0:1788197432.175236:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776263808:0@lo:13: 00000100:00100000:3.0:1788197432.175453:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197432.177876:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263808 00000100:00100000:2.0:1788197432.177894:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263808 00000100:00100000:2.0:1788197432.178019:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788197432.178030:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776263808:12345-0@lo:13: 00002000:00000024:2.0:1788197432.178073:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197432.178208:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776263808:12345-0@lo:13: Request processed in 179us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197432.178216:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788197432.178670:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2680 x1875060776263808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197432.178693:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776263808:0@lo:13: 00010000:00010000:3.0:1788197432.942812:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197432.956534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197432.956628:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755269760 00000100:00100000:1.0:1788197432.956638:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755269760 00000100:00100000:1.0:1788197432.956734:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1788197432.956746:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:0:x1875060755269760:12345-192.168.206.40@tcp:41: 00000004:00000024:1.0:1788197432.956787:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788197432.956886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:0:x1875060755269760:12345-192.168.206.40@tcp:41: Request processed in 142us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197432.956893:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00080000:3.0:1788197432.957337:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197432.963656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197432.963851:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755269888 00000100:00100000:1.0:1788197432.963863:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755269888 00000100:00100000:1.0:1788197432.963997:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:1.0:1788197432.964010:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5586:x1875060755269888:12345-192.168.206.40@tcp:41: 00000004:00000024:1.0:1788197432.964084:0:5871:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788197432.964173:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5586:x1875060755269888:12345-192.168.206.40@tcp:41: Request processed in 165us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197432.964181:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:0.0:1788197432.969375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197432.969965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270016 00000100:00100000:2.0:1788197432.969975:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270016 00000100:00100000:2.0:1788197432.970047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:2.0:1788197432.970173:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5586:x1875060755270016:12345-192.168.206.40@tcp:40: 00000100:00100000:2.0:1788197432.970405:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5586:x1875060755270016:12345-192.168.206.40@tcp:40: Request processed in 347us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197432.970415:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1788197432.990275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197432.990317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197432.990446:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270400 00000100:00100000:3.0:1788197432.990457:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270400 00000100:00100000:3.0:1788197432.990528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:3.0:1788197432.990539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5586:x1875060755270400:12345-192.168.206.40@tcp:33: 00000100:00100000:0.0:1788197432.992359:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197433.005805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197433.005875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270528 00000100:00100000:0.0:1788197433.005885:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270528 00000100:00100000:0.0:1788197433.005959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 128 00000100:00100000:0.0:1788197433.005970:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755270528:12345-192.168.206.40@tcp:400: 00000100:00100000:0.0:1788197433.006043:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755270528:12345-192.168.206.40@tcp:400: Request processed in 75us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197433.006051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 128 00000100:00100000:1.0:1788197433.010074:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270144 00000100:00100000:1.0:1788197433.010092:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270144 00000100:00100000:1.0:1788197433.010333:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270272 00000100:00100000:1.0:1788197433.010338:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270272 00000100:00100000:1.0:1788197433.010366:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1788197433.010374:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875060755270144:12345-192.168.206.40@tcp:8: 00010000:00080000:1.0:1788197433.010402:0:8021:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1788197433.010450:0:8021:0:(genops.c:1385:class_connect()) connect: client 87c79f47-cb13-4c8a-942c-8f23eb455b39, cookie 0x167e6c292402ffc1 00002000:00100000:1.0:1788197433.010462:0:8021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 87c79f47-cb13-4c8a-942c-8f23eb455b39/ffff93c741725000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788197433.010473:0:8021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788197433.011399:0:8021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788197433.011449:0:8021:0:(import.c:65:import_set_state_nolock()) ffff93c741727000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197433.011525:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2356:x1875060755270144:12345-192.168.206.40@tcp:8: Request processed in 1149us (21206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197433.011533:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1788197433.011559:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1788197433.011565:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875060755270272:12345-192.168.206.40@tcp:8: 00010000:00080000:1.0:1788197433.011585:0:8021:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1788197433.011606:0:8021:0:(genops.c:1385:class_connect()) connect: client 87c79f47-cb13-4c8a-942c-8f23eb455b39, cookie 0x167e6c292402ffc8 00002000:00100000:1.0:1788197433.011615:0:8021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 87c79f47-cb13-4c8a-942c-8f23eb455b39/ffff93c741721800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788197433.011648:0:8021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788197433.012737:0:8021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788197433.013783:0:8021:0:(import.c:65:import_set_state_nolock()) ffff93c741720800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197433.013861:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2356:x1875060755270272:12345-192.168.206.40@tcp:8: Request processed in 2292us (21510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197433.013872:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000004:00080000:3.0:1788197433.031672:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41066us 00000004:00200000:3.0:1788197433.049846:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788197433.049947:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5586:x1875060755270400:12345-192.168.206.40@tcp:33: Request processed in 59406us (59678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197433.049963:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:0.0:1788197433.274130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197433.274253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270656 00000100:00100000:2.0:1788197433.274265:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270656 00000100:00100000:2.0:1788197433.274332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1788197433.274345:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5625:x1875060755270656:12345-192.168.206.40@tcp:101: 00010000:00010000:2.0:1788197433.274372:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197433.274400:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c742142600/0x167e6c292402ffcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d566d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197433.274490:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c292402ffd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197433.274518:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c292402ffd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197433.274530:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c292402ffd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197433.274569:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788197433.274573:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197433.274591:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c292402ffd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197433.274617:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c742142600/0x167e6c292402ffcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d566d expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197433.274634:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c292402ffd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d566d expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197433.274642:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:2.0:1788197433.274645:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788197433.274649:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143400, rc 0) 00000100:00100000:2.0:1788197433.274706:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:5625:x1875060755270656:12345-192.168.206.40@tcp:101: Request processed in 364us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197433.274713:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00010000:00010000:0.0:1788197433.979631:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197434.990134:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197435.511364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197435.511441:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270784 00000100:00100000:2.0:1788197435.511450:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270784 00000100:00100000:2.0:1788197435.511516:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1788197435.511525:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:5678:x1875060755270784:12345-192.168.206.40@tcp:41: 00000004:00000024:2.0:1788197435.511565:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788197435.511655:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:5678:x1875060755270784:12345-192.168.206.40@tcp:41: Request processed in 130us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197435.511663:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00080000:3.0:1788197435.514773:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197435.516546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197435.516761:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755270912 00000100:00100000:2.0:1788197435.516770:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755270912 00000100:00100000:2.0:1788197435.516869:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1788197435.516890:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5678:x1875060755270912:12345-192.168.206.40@tcp:13: 00002000:00000024:2.0:1788197435.516924:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197435.516983:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5678:x1875060755270912:12345-192.168.206.40@tcp:13: Request processed in 104us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197435.516990:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00080000:3.0:1788197435.518086:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197435.522104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197435.522364:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271040 00000100:00100000:1.0:1788197435.522374:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271040 00000100:00100000:1.0:1788197435.522464:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1788197435.522476:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5678:x1875060755271040:12345-192.168.206.40@tcp:13: 00002000:00000024:1.0:1788197435.522519:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197435.522618:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:5678:x1875060755271040:12345-192.168.206.40@tcp:13: Request processed in 145us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197435.522634:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00080000:3.0:1788197435.524042:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788197436.018599:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197436.270060:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776264064:0@lo:400: 00000100:00100000:2.0:1788197436.270128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197436.270174:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776264576:0@lo:400: 00000100:00100000:0.0:1788197436.270247:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776263936:0@lo:400: 00000100:00100000:0.0:1788197436.270285:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197436.270320:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776264448:0@lo:400: 00000100:00100000:0.0:1788197436.270342:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197436.270375:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776264192:0@lo:400: 00000100:00100000:0.0:1788197436.270397:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197436.270429:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197436.270436:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776264320:0@lo:400: 00000100:00100000:2.0:1788197436.270546:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197436.270587:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264064 00000100:00100000:2.0:1788197436.270593:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264064 00000100:00100000:2.0:1788197436.270652:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264448 00000100:00100000:2.0:1788197436.270655:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264448 00000100:00100000:3.0:1788197436.270717:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264192 00000100:00100000:3.0:1788197436.270722:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264192 00000100:00100000:3.0:1788197436.270746:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788197436.270758:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776264064:12345-0@lo:400: 00000100:00100000:1.0:1788197436.270776:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776263936 00000100:00100000:1.0:1788197436.270780:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776263936 00000100:00100000:1.0:1788197436.270807:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788197436.270814:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776263936:12345-0@lo:400: 00000100:00100000:3.0:1788197436.270846:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776264064:12345-0@lo:400: Request processed in 55us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197436.271901:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788197436.271919:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776264192:12345-0@lo:400: 00000100:00100000:3.0:1788197436.272786:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788197436.272846:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788197436.272857:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776264448:12345-0@lo:400: 00000100:00100000:0.0:1788197436.274331:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197436.274432:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264576 00000100:00100000:0.0:1788197436.274440:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264576 00000100:00100000:1.0:1788197436.274537:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776263936:12345-0@lo:400: Request processed in 3721us (4249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197436.274547:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788197436.274569:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776264192:12345-0@lo:400: Request processed in 2655us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197436.274579:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788197436.274608:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197436.274612:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197436.274724:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776264064:0@lo:400: 00000100:00100000:1.0:1788197436.275025:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264320 00000100:00100000:3.0:1788197436.275026:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776264448:12345-0@lo:400: Request processed in 2170us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197436.275028:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264320 00000100:00100000:3.0:1788197436.275034:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788197436.275059:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788197436.275068:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776264576:12345-0@lo:400: 00000100:00080000:2.0:1788197436.275172:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197436.275283:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776264576:12345-0@lo:400: Request processed in 215us (4735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197436.275298:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788197436.275313:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788197436.275320:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776264320:12345-0@lo:400: 00000100:00100000:1.0:1788197436.275352:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776264320:12345-0@lo:400: Request processed in 33us (1026us total) trans 0 rc 0/0 00010000:00080000:3.0:1788197436.275403:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7057a1500 x1875060776264576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788197436.275409:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e0a80 x1875060776264320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197436.275414:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776264576:0@lo:400: 00000100:00100000:0.0:1788197436.275431:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776264320:0@lo:400: 00000100:00100000:1.0:1788197436.275559:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788197436.275593:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776263936:0@lo:400: 00000100:00100000:1.0:1788197436.275607:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776264448:0@lo:400: 00000100:00100000:0.0:1788197436.275730:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776264192:0@lo:400: 00000100:00100000:0.0:1788197436.786097:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788197436.786341:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776264704:0@lo:13: 00000100:00100000:0.0:1788197436.786411:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197436.786572:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264704 00000100:00100000:0.0:1788197436.786579:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264704 00000100:00100000:0.0:1788197436.786988:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788197436.787000:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776264704:12345-0@lo:13: 00002000:00000024:0.0:1788197436.787024:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197436.787074:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776264704:12345-0@lo:13: Request processed in 78us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197436.787081:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788197436.787340:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c1fb480 x1875060776264704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197436.787360:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776264704:0@lo:13: 00010000:00010000:2.0:1788197437.039918:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197437.297634:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776264832:0@lo:13: 00000100:00100000:3.0:1788197437.297704:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197437.297787:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264832 00000100:00100000:3.0:1788197437.297794:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264832 00000100:00100000:3.0:1788197437.297862:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788197437.297872:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776264832:12345-0@lo:13: 00002000:00000024:3.0:1788197437.297921:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197437.297965:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776264832:12345-0@lo:13: Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197437.297973:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788197437.298233:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480dc00 x1875060776264832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197437.298251:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776264832:0@lo:13: 00000001:00100000:3.0:1788197437.379307:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000001:00100000:2.0:1788197437.385069:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000001:00100000:3.0:1788197437.400765:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00010000:00010000:0.0:1788197438.063339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197438.068575:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197438.068625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197438.068657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197438.068683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197438.068710:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271296 00000100:00100000:1.0:1788197438.068719:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271296 00000100:00100000:1.0:1788197438.068778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:1.0:1788197438.068787:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755271296:12345-192.168.206.40@tcp:400: 00000100:00100000:1.0:1788197438.068875:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755271296:12345-192.168.206.40@tcp:400: Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197438.068883:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:1.0:1788197438.068905:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271424 00000100:00100000:1.0:1788197438.068908:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271424 00000100:00100000:1.0:1788197438.068932:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271552 00000100:00100000:1.0:1788197438.068935:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271552 00000100:00100000:1.0:1788197438.068955:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1788197438.068961:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755271424:12345-192.168.206.40@tcp:400: 00000100:00100000:1.0:1788197438.069002:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755271424:12345-192.168.206.40@tcp:400: Request processed in 41us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197438.069009:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1788197438.069020:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1788197438.069026:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755271552:12345-192.168.206.40@tcp:400: 00000100:00100000:1.0:1788197438.069047:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755271552:12345-192.168.206.40@tcp:400: Request processed in 21us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197438.069053:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00080000:1.0:1788197438.069068:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788197438.069071:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788197438.069074:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197438.069859:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271168 00000100:00100000:2.0:1788197438.069867:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271168 00000100:00100000:2.0:1788197438.069920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:2.0:1788197438.069929:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:2359:x1875060755271168:12345-192.168.206.40@tcp:400: 00000100:00100000:2.0:1788197438.069977:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:2359:x1875060755271168:12345-192.168.206.40@tcp:400: Request processed in 49us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197438.069983:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 130 00000001:02000400:1.0:1788197438.370600:0:8316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788197439.086051:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197440.113794:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197441.134415:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197441.397476:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776264960:0@lo:400: 00000100:00100000:0.0:1788197441.397548:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197441.397668:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776265088:0@lo:400: 00000100:00100000:3.0:1788197441.397709:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197441.397751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776265088 00000100:00100000:3.0:1788197441.397758:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776265088 00000100:00100000:3.0:1788197441.397872:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788197441.397891:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776265088:12345-0@lo:400: 00000100:00100000:3.0:1788197441.397941:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776265088:12345-0@lo:400: Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197441.397948:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788197441.399009:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776264960 00000100:00100000:0.0:1788197441.399027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776264960 00000100:00100000:0.0:1788197441.399476:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788197441.399488:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776264960:12345-0@lo:400: 00000100:00100000:0.0:1788197441.399577:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776264960:12345-0@lo:400: Request processed in 92us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197441.399584:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788197441.399722:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776264960:0@lo:400: 00000100:00100000:0.0:1788197441.399755:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776265472:0@lo:400: 00000100:00100000:3.0:1788197441.399773:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776265600:0@lo:400: 00000100:00100000:0.0:1788197441.399792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197441.399816:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197441.399841:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776265472 00000100:00100000:1.0:1788197441.399847:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776265472 00000100:00100000:3.0:1788197441.399869:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776265088:0@lo:400: 00000100:00080000:0.0:1788197441.399879:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197441.399900:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776265216:0@lo:400: 00000100:00100000:3.0:1788197441.399926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197441.399955:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197441.400266:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776265216 00000100:00100000:1.0:1788197441.400270:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776265216 00000100:00100000:1.0:1788197441.400299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788197441.400307:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776265472:12345-0@lo:400: 00000100:00100000:1.0:1788197441.400354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776265472:12345-0@lo:400: Request processed in 48us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197441.400360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788197441.400467:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788197441.400475:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776265216:12345-0@lo:400: 00000100:00100000:1.0:1788197441.400668:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776265216:12345-0@lo:400: Request processed in 193us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197441.400675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788197441.401144:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776265344:0@lo:400: 00000100:00100000:3.0:1788197441.401427:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197441.401473:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776265216:0@lo:400: 00000100:00100000:3.0:1788197441.401516:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776265600 00000100:00100000:3.0:1788197441.401521:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776265600 00000100:00100000:3.0:1788197441.401567:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776265344 00000100:00100000:3.0:1788197441.401570:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776265344 00000100:00080000:0.0:1788197441.402082:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197441.402087:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197441.402089:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197441.402121:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776265472:0@lo:400: 00000100:00100000:3.0:1788197441.402461:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788197441.402474:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776265600:12345-0@lo:400: 00000100:00100000:3.0:1788197441.402541:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776265600:12345-0@lo:400: Request processed in 71us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197441.402547:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788197441.402563:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788197441.402569:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776265344:12345-0@lo:400: 00000100:00100000:3.0:1788197441.402617:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776265344:12345-0@lo:400: Request processed in 49us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197441.402623:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788197441.410349:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c708389880 x1875060776265600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197441.410367:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776265600:0@lo:400: 00010000:00080000:2.0:1788197441.415325:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6066dc000 x1875060776265344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197441.415348:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776265344:0@lo:400: 00000100:00100000:1.0:1788197441.907340:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776265728:0@lo:13: 00000100:00100000:1.0:1788197441.907416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197441.907490:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776265728 00000100:00100000:1.0:1788197441.907496:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776265728 00000100:00100000:1.0:1788197441.907536:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788197441.907544:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776265728:12345-0@lo:13: 00002000:00000024:1.0:1788197441.907576:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197441.907615:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776265728:12345-0@lo:13: Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197441.907622:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788197441.908398:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70838a680 x1875060776265728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197441.908421:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776265728:0@lo:13: 00010000:00010000:0.0:1788197442.161495:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197442.418367:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776265856:0@lo:13: 00000100:00100000:3.0:1788197442.418474:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197442.418548:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776265856 00000100:00100000:3.0:1788197442.418555:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776265856 00000100:00100000:3.0:1788197442.418599:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788197442.418608:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776265856:12345-0@lo:13: 00002000:00000024:3.0:1788197442.418638:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197442.418689:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776265856:12345-0@lo:13: Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197442.418696:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788197442.418739:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480f480 x1875060776265856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197442.418757:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776265856:0@lo:13: 00000020:00000080:3.0:1788197442.558985:0:8463:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc12ed0790 20000000:00000080:3.0:1788197442.559001:0:8463:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c73c08d000 uarg=0000000000000000 20000000:01000000:3.0:1788197442.559040:0:8463:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788197442.559043:0:8463:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788197442.559046:0:8463:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788197442.559050:0:8463:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788197442.559055:0:8463:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788197442.559067:0:8463:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788197442.559069:0:8463:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788197442.559261:0:8463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788197442.559264:0:8463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788197442.560505:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788197442.561001:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788197442.561055:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788197442.561106:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788197442.561119:0:8463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788197442.561121:0:8463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788197442.563804:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788197442.564316:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788197442.564373:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788197442.564418:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788197442.564430:0:8463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788197442.564432:0:8463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788197442.565474:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788197442.565789:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788197442.565913:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788197442.565943:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788197442.565954:0:8463:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788197442.565963:0:8463:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788197442.567627:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788197442.568063:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788197442.568119:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788197442.568155:0:8463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1788197442.568243:0:8463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788197442.568263:0:8463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568279:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fed3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568287:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fefd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568294:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff27 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568314:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff35 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568321:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff43 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568328:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568334:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ff89 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568343:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568350:0:8463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568358:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568404:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568420:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 9 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568435:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776265984:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197442.568576:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568591:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 9 pid: 5836 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568600:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266112:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197442.568627:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402ff89 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568635:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402ff89 expref: 18 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568643:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266240:0@lo:104: 00000100:00100000:1.0:1788197442.568674:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197442.568719:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402ff5f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568726:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402ff5f expref: 18 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568734:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266368:0@lo:104: 00000100:00100000:1.0:1788197442.568756:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197442.568780:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402ff43 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568787:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402ff43 expref: 18 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568794:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266496:0@lo:104: 00010000:00010000:1.0:1788197442.568814:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402ff35 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568850:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402ff35 expref: 18 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568860:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266624:0@lo:104: 00010000:00010000:1.0:1788197442.568887:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402ff27 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568894:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402ff27 expref: 18 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568901:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266752:0@lo:104: 00010000:00010000:1.0:1788197442.568921:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fefd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568929:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fefd expref: 18 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568936:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266880:0@lo:104: 00010000:00010000:1.0:1788197442.568958:0:8463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fed3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197442.568965:0:8463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fed3 expref: 18 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.568973:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776267008:0@lo:104: 00000100:00100000:1.0:1788197442.568991:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788197442.569109:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788197442.569127:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197442.569139:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197442.569147:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197442.569161:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197442.569181:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197442.569189:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776266240 00000100:00100000:2.0:1788197442.569195:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776266240 00000100:00100000:2.0:1788197442.569228:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776266368 00000100:00100000:2.0:1788197442.569231:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776266368 00000100:00100000:2.0:1788197442.569240:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776266496 00000100:00100000:2.0:1788197442.569249:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776266496 00000100:00100000:2.0:1788197442.569261:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776266624 00000100:00100000:2.0:1788197442.569264:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776266624 00000100:00100000:2.0:1788197442.569272:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776266752 00000100:00100000:2.0:1788197442.569274:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776266752 00000100:00100000:2.0:1788197442.569283:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776266880 00000100:00100000:2.0:1788197442.569285:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776266880 00000100:00100000:2.0:1788197442.569293:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267008 00000100:00100000:2.0:1788197442.569295:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267008 00000100:00100000:2.0:1788197442.569309:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788197442.569317:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:8463:x1875060776266240:12345-0@lo:104: 00010000:00010000:2.0:1788197442.569330:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.569399:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197442.569409:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+9:8463:x1875060776266240:12345-0@lo:104: Request processed in 90us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.569417:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788197442.569433:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788197442.569439:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+8:8463:x1875060776266368:12345-0@lo:104: 00010000:00010000:2.0:1788197442.569447:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.569479:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788197442.569484:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+8:8463:x1875060776266368:12345-0@lo:104: Request processed in 46us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.569489:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788197442.569518:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788197442.569524:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+7:8463:x1875060776266496:12345-0@lo:104: 00010000:00010000:2.0:1788197442.569539:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.569564:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788197442.569568:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+7:8463:x1875060776266496:12345-0@lo:104: Request processed in 45us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.569573:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788197442.569583:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197442.569589:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+6:8463:x1875060776266624:12345-0@lo:104: 00010000:00010000:2.0:1788197442.569595:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.569618:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788197442.569623:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+6:8463:x1875060776266624:12345-0@lo:104: Request processed in 35us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.569629:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197442.569640:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197442.569646:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:8463:x1875060776266752:12345-0@lo:104: 00010000:00010000:2.0:1788197442.569652:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.569674:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788197442.569679:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:8463:x1875060776266752:12345-0@lo:104: Request processed in 34us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.569684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197442.569694:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788197442.569699:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:8463:x1875060776266880:12345-0@lo:104: 00010000:00010000:2.0:1788197442.569711:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.569736:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788197442.569741:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:8463:x1875060776266880:12345-0@lo:104: Request processed in 42us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.569747:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788197442.569758:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788197442.569764:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:8463:x1875060776267008:12345-0@lo:104: 00010000:00010000:2.0:1788197442.569770:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.569793:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788197442.569797:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:8463:x1875060776267008:12345-0@lo:104: Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.569803:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788197442.569946:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266240:0@lo:104: 00000100:00100000:1.0:1788197442.569955:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266368:0@lo:104: 00000100:00100000:1.0:1788197442.569971:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266496:0@lo:104: 00000100:00100000:1.0:1788197442.569977:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266624:0@lo:104: 00000100:00100000:1.0:1788197442.569983:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266752:0@lo:104: 00000100:00100000:1.0:1788197442.569989:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266880:0@lo:104: 00000100:00100000:1.0:1788197442.569996:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776267008:0@lo:104: 00010000:00010000:2.0:1788197442.572995:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788197442.573009:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573021:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197442.573025:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573036:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197442.573043:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197442.573062:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197442.573115:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573122:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197442.573149:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573157:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c292402ff89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff90 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197442.573242:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788197442.573263:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776267136:0@lo:103: 00000100:00100000:1.0:1788197442.573329:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788197442.573406:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788197442.573411:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573417:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197442.573420:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573427:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197442.573433:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197442.573439:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197442.573455:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573461:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788197442.573506:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776267264:0@lo:103: 00000100:00100000:1.0:1788197442.573530:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788197442.573774:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573782:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c292402ff5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff66 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573792:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788197442.573796:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573801:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742142800 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197442.573804:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573810:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197442.573817:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197442.573846:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197442.573863:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573868:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197442.573879:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573885:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742142800/0x167e6c292402ff43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff4a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573894:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788197442.573904:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573909:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386400 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197442.573913:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573920:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197442.573926:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197442.573930:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197442.573945:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573951:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197442.573957:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573963:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292402ff35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff3c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573974:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788197442.573978:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.573983:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7600 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197442.573986:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.574004:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197442.574010:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197442.574015:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197442.574030:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.574036:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788197442.574124:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776267648:0@lo:103: 00000100:00100000:0.0:1788197442.574158:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197442.574369:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267136 00000100:00100000:0.0:1788197442.574377:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267136 00010000:00010000:0.0:1788197442.574415:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff89 expref: 19 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197442.574435:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267264 00000100:00100000:0.0:1788197442.574438:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267264 00010000:00010000:0.0:1788197442.574450:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff5f expref: 20 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197442.574460:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267648 00000100:00100000:0.0:1788197442.574463:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267648 00010000:00010000:0.0:1788197442.574473:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff27 expref: 21 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197442.574486:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788197442.574494:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+21:3312:x1875060776267136:12345-0@lo:103: 00010000:00010000:0.0:1788197442.574505:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197442.574510:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff89 expref: 21 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574526:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402ff89 expref: 21 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574540:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7a00/0x167e6c292402ff90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402ff89 expref: 21 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574553:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197442.574637:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+20:3312:x1875060776267136:12345-0@lo:103: Request processed in 142us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197442.574644:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788197442.574661:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788197442.574667:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776267264:12345-0@lo:103: 00010000:00010000:0.0:1788197442.574675:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197442.574679:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff5f expref: 19 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574687:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402ff5f expref: 19 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574697:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7e00/0x167e6c292402ff66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402ff5f expref: 19 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574705:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197442.574728:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3312:x1875060776267264:12345-0@lo:103: Request processed in 61us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197442.574734:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788197442.574747:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788197442.574753:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3311:x1875060776267648:12345-0@lo:103: 00010000:00010000:0.0:1788197442.574766:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197442.574772:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff27 expref: 17 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574780:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402ff27 expref: 17 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574790:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701386000/0x167e6c292402ff2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402ff27 expref: 17 pid: 5836 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.574799:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197442.574856:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3311:x1875060776267648:12345-0@lo:103: Request processed in 102us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197442.574862:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788197442.574892:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776267648:0@lo:103: 00010000:00010000:2.0:1788197442.575007:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575015:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292402ff27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.575024:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776267392:0@lo:103: 00010000:00010000:2.0:1788197442.575025:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788197442.575029:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575034:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742142200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197442.575037:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575044:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197442.575050:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.575052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788197442.575060:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788197442.575076:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788197442.575082:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776267520:0@lo:103: 00010000:00010000:2.0:1788197442.575082:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575088:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197442.575098:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.575100:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788197442.575105:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c292402fefd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402ff04 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575114:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197442.575117:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575122:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7c00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197442.575125:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575131:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197442.575137:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197442.575143:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197442.575155:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575160:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788197442.575414:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267392 00000100:00100000:3.0:1788197442.575420:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267392 00010000:00010000:3.0:1788197442.575450:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff43 expref: 16 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.575465:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267520 00000100:00100000:3.0:1788197442.575468:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267520 00010000:00010000:3.0:1788197442.575479:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff35 expref: 17 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.575491:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788197442.575497:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3313:x1875060776267392:12345-0@lo:103: 00010000:00010000:3.0:1788197442.575504:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197442.575508:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff43 expref: 17 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197442.575516:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402ff43 expref: 17 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197442.575526:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030e00/0x167e6c292402ff4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402ff43 expref: 17 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197442.575534:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197442.575579:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575586:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292402fed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402feda expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575609:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197442.575611:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197442.575613:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197442.575617:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3313:x1875060776267392:12345-0@lo:103: Request processed in 120us (564us total) trans 0 rc 0/0 00010000:00010000:2.0:1788197442.575620:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197442.575624:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197442.575631:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197442.575639:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:3313:x1875060776267520:12345-0@lo:103: 00010000:00010000:2.0:1788197442.575646:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197442.575650:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402ff35 expref: 15 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575659:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402ff35 expref: 15 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575669:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6800/0x167e6c292402ff3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402ff35 expref: 15 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575677:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197442.575697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197442.575698:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3313:x1875060776267520:12345-0@lo:103: Request processed in 62us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.575704:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197442.575715:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271680 00000100:00100000:2.0:1788197442.575718:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271680 00010000:00010000:2.0:1788197442.575731:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197442.575755:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:2.0:1788197442.575761:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+10:2359:x1875060755271680:12345-192.168.206.40@tcp:103: 00000100:00100000:3.0:1788197442.575765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:2.0:1788197442.575770:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197442.575774:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.575781:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776267904:0@lo:103: 00010000:00010000:2.0:1788197442.575784:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.575793:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197442.575804:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197442.576030:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776267520:0@lo:103: 00000100:00100000:3.0:1788197442.576038:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776267392:0@lo:103: 00000100:00100000:3.0:1788197442.576070:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788197442.576078:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788197442.576098:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788197442.576104:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271808 00000100:00100000:3.0:1788197442.576107:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271808 00010000:00010000:3.0:1788197442.576119:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 11 pid: 5836 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.576269:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788197442.576276:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267904 00000100:00100000:3.0:1788197442.576279:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267904 00010000:00010000:3.0:1788197442.576292:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fed3 expref: 14 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197442.576303:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788197442.576392:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:2.0:1788197442.576396:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+11:2359:x1875060755271680:12345-192.168.206.40@tcp:103: Request processed in 635us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197442.576400:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7066c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05358cfc-7070-4d77-b166-215daa591621+11:2360:x1875060755271808:12345-192.168.206.40@tcp:103: 00000100:00100000:2.0:1788197442.576403:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00010000:00010000:3.0:1788197442.576408:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197442.576412:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 10 pid: 5836 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197442.576416:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788197442.576422:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788197442.576427:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3313:x1875060776267904:12345-0@lo:103: 00010000:00010000:3.0:1788197442.576429:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 10 pid: 5836 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.576434:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197442.576439:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fed3 expref: 14 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.577057:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142400/0x167e6c292402ffa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5612 expref: 10 pid: 5833 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197442.577071:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776265984:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197442.577081:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8463:1875060776266112:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197442.577511:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fed3 expref: 14 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.577528:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030c00/0x167e6c292402feda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fed3 expref: 14 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.577539:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197442.577572:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7800/0x167e6c292402ff9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d560b expref: 9 pid: 5836 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197442.577582:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197442.577609:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7066c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05358cfc-7070-4d77-b166-215daa591621+8:2360:x1875060755271808:12345-192.168.206.40@tcp:103: Request processed in 1210us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197442.577617:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1788197442.578075:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776267136:0@lo:103: 00000100:00100000:1.0:1788197442.578098:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776267776:0@lo:103: 00000100:00100000:1.0:1788197442.578133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197442.578175:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776267264:0@lo:103: 00000100:00100000:3.0:1788197442.578509:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776267776 00000100:00100000:3.0:1788197442.578516:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776267776 00010000:00010000:3.0:1788197442.578539:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fefd expref: 14 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197442.578640:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3313:x1875060776267904:12345-0@lo:103: Request processed in 2210us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.578647:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788197442.578664:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788197442.578672:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:3312:x1875060776267776:12345-0@lo:103: 00010000:00010000:2.0:1788197442.578684:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197442.578689:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fefd expref: 13 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578697:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fefd expref: 13 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578709:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030400/0x167e6c292402ff04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fefd expref: 13 pid: 5833 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578722:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578730:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578743:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578750:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578756:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578762:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578775:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197442.578780:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578788:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578797:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197442.578806:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197442.578853:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:3312:x1875060776267776:12345-0@lo:103: Request processed in 183us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197442.578860:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788197442.579004:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776267776:0@lo:103: 00000100:00100000:2.0:1788197442.579485:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776267904:0@lo:103: 00010000:00010000:0.0:1788197442.579720:0:8463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.579731:0:8463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.579736:0:8463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197442.579756:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701386a00/0x167e6c292402ffdd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197443.182093:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197443.183923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197443.183954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197443.183987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197443.184140:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755271936 00000100:00100000:1.0:1788197443.184150:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755271936 00000100:00100000:1.0:1788197443.184240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:1.0:1788197443.184251:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755271936:12345-192.168.206.40@tcp:400: 00000100:00100000:1.0:1788197443.184321:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755271936:12345-192.168.206.40@tcp:400: Request processed in 72us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197443.184329:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00080000:0.0:1788197443.184628:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197443.186086:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272192 00000100:00100000:2.0:1788197443.186102:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272192 00000100:00100000:2.0:1788197443.186177:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272064 00000100:00100000:2.0:1788197443.186181:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272064 00000100:00100000:2.0:1788197443.186207:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00080000:0.0:1788197443.186207:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197443.186212:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788197443.186237:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755272192:12345-192.168.206.40@tcp:400: 00000100:00100000:2.0:1788197443.186332:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755272192:12345-192.168.206.40@tcp:400: Request processed in 97us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197443.186340:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1788197443.186359:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1788197443.186366:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755272064:12345-192.168.206.40@tcp:400: 00000100:00100000:2.0:1788197443.186991:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755272064:12345-192.168.206.40@tcp:400: Request processed in 621us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197443.186999:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 10000000:01000000:3.0:1788197444.206027:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788197444.206038:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c736929000 from 39 10000000:01000000:3.0:1788197444.206044:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788197444.206102:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.206114:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.206126:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197444.206150:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268032:0@lo:101: 00000100:00100000:3.0:1788197444.206232:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.206355:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268032 00000100:00100000:1.0:1788197444.206371:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268032 00000100:00100000:1.0:1788197444.206440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788197444.206450:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+12:5839:x1875060776268032:12345-0@lo:101: 00010000:00010000:1.0:1788197444.206463:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197444.206476:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701386a00/0x167e6c292402ffeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402ffe4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.206500:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701386a00/0x167e6c292402ffeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402ffe4 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.206512:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701386a00/0x167e6c292402ffeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402ffe4 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.206523:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386a00, rc 0) 00000100:00100000:3.0:1788197444.206738:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788197444.207371:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197444.210217:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776268032:12345-0@lo:101: Request processed in 3750us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197444.210231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788197444.211367:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268032:0@lo:101: 00010000:00010000:0.0:1788197444.211403:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197444.211416:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197444.211505:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268160:0@lo:501: 00000100:00100000:0.0:1788197444.211555:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197444.211599:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414003c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.213302:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268160 00000100:00100000:2.0:1788197444.213328:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268160 00000100:00100000:2.0:1788197444.213401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788197444.213412:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776268160:12345-0@lo:501: 00000100:00100000:2.0:1788197444.213773:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776268160:12345-0@lo:501: Request processed in 362us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.213782:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788197444.214100:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268160:0@lo:501: 00000100:00100000:3.0:1788197444.214154:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268288:0@lo:503: 00000100:00100000:3.0:1788197444.214217:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.214255:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788197444.214319:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268288 00000100:00100000:1.0:1788197444.214324:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268288 00000100:00100000:1.0:1788197444.214365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788197444.214386:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776268288:12345-0@lo:503: 00000100:00100000:1.0:1788197444.214544:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776268288:12345-0@lo:503: Request processed in 171us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197444.214551:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788197444.214629:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268288:0@lo:503: 00000100:00100000:1.0:1788197444.221629:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8481:1875060776268416:0@lo:502: 00000100:00100000:1.0:1788197444.221716:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.221769:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.221847:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268416 00000100:00100000:0.0:1788197444.221855:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268416 00000100:00100000:0.0:1788197444.221900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788197444.221909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:8481:x1875060776268416:12345-0@lo:502: 00000100:00100000:0.0:1788197444.222166:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:8481:x1875060776268416:12345-0@lo:502: Request processed in 257us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197444.222174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788197444.222259:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8481:1875060776268416:0@lo:502: 00000100:00100000:2.0:1788197444.222308:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8481:1875060776268544:0@lo:502: 00000100:00100000:2.0:1788197444.222342:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.222384:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c74131c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788197444.222487:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268544 00000100:00100000:1.0:1788197444.222498:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268544 00000100:00100000:1.0:1788197444.222601:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788197444.222610:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:8481:x1875060776268544:12345-0@lo:502: 00000100:00100000:1.0:1788197444.222764:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:8481:x1875060776268544:12345-0@lo:502: Request processed in 155us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197444.222770:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788197444.222856:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8481:1875060776268544:0@lo:502: 00000040:00080000:3.0:1788197444.222878:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788197444.222935:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788197444.222954:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788197444.222963:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.222972:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197444.222981:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788197444.222984:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788197444.222986:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788197444.223009:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.223017:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.223025:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197444.223038:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268672:0@lo:101: 00000100:00100000:3.0:1788197444.223086:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.232649:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.245063:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268672 00000100:00100000:2.0:1788197444.245084:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268672 00000100:00100000:2.0:1788197444.245224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788197444.245236:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+13:5839:x1875060776268672:12345-0@lo:101: 00010000:00010000:2.0:1788197444.245313:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197444.245335:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142200/0x167e6c292402fff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292402fff2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.245367:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142200/0x167e6c292402fff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292402fff2 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.245392:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142200/0x167e6c292402fff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fff2 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.245419:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142200, rc 0) 00000100:00100000:2.0:1788197444.245759:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776268672:12345-0@lo:101: Request processed in 525us (22671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.245766:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788197444.245941:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268672:0@lo:101: 00010000:00010000:3.0:1788197444.245960:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.245970:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197444.246212:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268800:0@lo:501: 00000100:00100000:3.0:1788197444.246255:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.246327:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788197444.246363:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268800 00000100:00100000:1.0:1788197444.246369:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268800 00000100:00100000:1.0:1788197444.246454:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788197444.246471:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776268800:12345-0@lo:501: 00000100:00100000:1.0:1788197444.246728:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776268800:12345-0@lo:501: Request processed in 265us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197444.246734:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788197444.246795:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268800:0@lo:501: 00000100:00100000:3.0:1788197444.246871:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268928:0@lo:503: 00000100:00100000:3.0:1788197444.246910:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.247940:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.248002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776268928 00000100:00100000:2.0:1788197444.248009:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776268928 00000100:00100000:2.0:1788197444.248273:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788197444.248284:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776268928:12345-0@lo:503: 00000100:00100000:2.0:1788197444.248775:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776268928:12345-0@lo:503: Request processed in 493us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.248784:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788197444.248975:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776268928:0@lo:503: 00000100:00100000:1.0:1788197444.250271:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8482:1875060776269056:0@lo:502: 00000100:00100000:1.0:1788197444.250351:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.250396:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.250515:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269056 00000100:00100000:2.0:1788197444.250522:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269056 00000100:00100000:2.0:1788197444.250566:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788197444.250732:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8482:x1875060776269056:12345-0@lo:502: 00000100:00100000:2.0:1788197444.251103:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8482:x1875060776269056:12345-0@lo:502: Request processed in 375us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.251112:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788197444.251272:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8482:1875060776269056:0@lo:502: 00000020:01000000:1.0:1788197444.251302:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788197444.251310:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197444.251313:0:8482:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788197444.251317:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788197444.251342:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8482:1875060776269184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197444.251391:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.251420:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197444.251471:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269184 00000100:00100000:3.0:1788197444.251476:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269184 00000100:00100000:3.0:1788197444.251510:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788197444.251517:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8482:x1875060776269184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197444.251868:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:8482:x1875060776269184:12345-0@lo:502:llog_process_th.0 Request processed in 349us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197444.251875:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788197444.251999:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8482:1875060776269184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788197444.252020:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788197444.252101:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197444.252103:0:8482:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788197444.252107:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788197444.252429:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788197444.252450:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788197444.252537:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.252548:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197444.252558:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788197444.252561:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c70f634000 from 39 10000000:01000000:3.0:1788197444.252564:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788197444.252708:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.252717:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.252726:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197444.252741:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788197444.252774:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.252807:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.252969:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269312 00000100:00100000:2.0:1788197444.252975:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269312 00000100:00100000:2.0:1788197444.255034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788197444.255058:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:5839:x1875060776269312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197444.255076:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197444.255095:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142800/0x167e6c2924030007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924030000 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.255141:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142800/0x167e6c2924030007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924030000 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.255151:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142800/0x167e6c2924030007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030000 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.255160:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142800, rc 0) 00000100:00100000:2.0:1788197444.255232:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776269312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.255239:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788197444.257074:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197444.257115:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.257128:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197444.257212:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.257268:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.257313:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c74131c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.257350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269440 00000100:00100000:0.0:1788197444.257386:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269440 00000100:00100000:0.0:1788197444.257443:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788197444.257453:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776269440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197444.257891:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776269440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 437us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197444.257899:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788197444.261013:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197444.261625:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197444.261710:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.261753:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.262263:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269568 00000100:00100000:2.0:1788197444.262273:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269568 00000100:00100000:2.0:1788197444.262341:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788197444.262351:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776269568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.262606:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776269568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.262622:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788197444.262982:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.263982:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8483:1875060776269696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197444.264263:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.264396:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.264438:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269696 00000100:00100000:0.0:1788197444.264446:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269696 00000100:00100000:0.0:1788197444.264750:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788197444.264761:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8483:x1875060776269696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197444.266096:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8483:x1875060776269696:12345-0@lo:502:llog_process_th.0 Request processed in 1331us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197444.266107:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788197444.266241:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8483:1875060776269696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197444.266309:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8483:1875060776269824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197444.266364:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.267308:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.267395:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269824 00000100:00100000:2.0:1788197444.267404:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269824 00000100:00100000:2.0:1788197444.267565:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788197444.267917:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8483:x1875060776269824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197444.268473:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:8483:x1875060776269824:12345-0@lo:502:llog_process_th.0 Request processed in 644us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.268483:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788197444.271803:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8483:1875060776269824:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788197444.271946:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788197444.272733:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788197444.272761:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788197444.272772:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.272783:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197444.272792:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788197444.272794:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788197444.272797:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788197444.272877:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.272886:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.272896:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197444.272920:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.272998:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.273053:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c727268cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197444.274155:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776269952 00000100:00100000:3.0:1788197444.274164:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776269952 00000100:00100000:3.0:1788197444.274225:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788197444.274236:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:5839:x1875060776269952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197444.274249:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197444.274264:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7400/0x167e6c2924030015 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403000e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.274290:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7400/0x167e6c2924030015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403000e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.274302:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7400/0x167e6c2924030015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403000e expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197444.274311:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7400, rc 0) 00000100:00100000:3.0:1788197444.274367:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776269952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197444.274384:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788197444.274554:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776269952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197444.274693:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.274703:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197444.274765:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.274796:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.274996:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c727268cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.275866:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270080 00000100:00100000:0.0:1788197444.275876:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270080 00000100:00100000:3.0:1788197444.276151:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788197444.276163:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776270080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197444.276522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776270080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197444.276530:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788197444.277520:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.280299:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.280400:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.280497:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c727268cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197444.280917:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270208 00000100:00100000:3.0:1788197444.280926:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270208 00000100:00100000:3.0:1788197444.281150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788197444.281162:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776270208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197444.281367:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776270208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197444.281385:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788197444.281474:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.282483:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8484:1875060776270336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197444.282554:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.285115:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c727268c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.285339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270336 00000100:00100000:0.0:1788197444.285351:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270336 00000100:00100000:0.0:1788197444.285417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788197444.285428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8484:x1875060776270336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197444.287402:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8484:x1875060776270336:12345-0@lo:502:llog_process_th.0 Request processed in 1967us (4839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197444.287414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788197444.287780:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8484:1875060776270336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788197444.288008:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197444.288019:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197444.288021:0:8484:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788197444.288091:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788197444.288303:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8484:1875060776270464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197444.288357:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.288433:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c727268c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788197444.288490:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270464 00000100:00100000:1.0:1788197444.288498:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270464 00000100:00100000:3.0:1788197444.288884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788197444.288917:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8484:x1875060776270464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197444.289456:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:8484:x1875060776270464:12345-0@lo:502:llog_process_th.0 Request processed in 560us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197444.289472:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788197444.289808:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8484:1875060776270464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788197444.289869:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197444.289876:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197444.289879:0:8484:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788197444.289883:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788197444.290163:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788197444.290181:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788197444.290191:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.290201:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197444.290210:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788197444.290213:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c706bce800 from 39 10000000:01000000:1.0:1788197444.290216:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788197444.290248:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.290255:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.290264:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197444.290282:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.290329:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.290395:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.291925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270592 00000100:00100000:2.0:1788197444.291940:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270592 00000100:00100000:2.0:1788197444.291999:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788197444.292010:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776270592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197444.292243:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197444.292265:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143e00/0x167e6c2924030023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403001c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.292296:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143e00/0x167e6c2924030023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403001c expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.292307:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143e00/0x167e6c2924030023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403001c expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.292315:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143e00, rc 0) 00000100:00100000:2.0:1788197444.292397:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776270592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 388us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.292404:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788197444.292505:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788197444.292522:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.292531:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197444.292601:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.292629:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.292659:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.292807:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270720 00000100:00100000:2.0:1788197444.292811:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270720 00000100:00100000:2.0:1788197444.292868:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788197444.292888:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776270720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.293115:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776270720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.293122:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788197444.293871:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.293909:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.293955:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.293981:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.294199:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270848 00000100:00100000:0.0:1788197444.294205:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270848 00000100:00100000:0.0:1788197444.294231:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788197444.294238:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776270848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197444.294406:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776270848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197444.294420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788197444.294520:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776270848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197444.295904:0:8485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8485:1875060776270976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197444.295974:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197444.296013:0:8485:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741400000 going to sleep for 11 seconds 00000100:00100000:1.0:1788197444.296117:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776270976 00000100:00100000:1.0:1788197444.296123:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776270976 00000100:00100000:1.0:1788197444.296160:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788197444.296168:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8485:x1875060776270976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197444.296382:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8485:x1875060776270976:12345-0@lo:502:llog_process_th.0 Request processed in 204us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197444.296390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788197444.296469:0:8485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8485:1875060776270976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197444.296514:0:8485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8485:1875060776271104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197444.296547:0:8485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.296714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776271104 00000100:00100000:1.0:1788197444.296719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776271104 00000100:00100000:1.0:1788197444.296738:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788197444.296752:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8485:x1875060776271104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197444.296900:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8485:x1875060776271104:12345-0@lo:502:llog_process_th.0 Request processed in 149us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197444.296907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788197444.296989:0:8485:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c72714bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.297004:0:8485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8485:1875060776271104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788197444.297124:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788197444.297279:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788197444.297299:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788197444.297308:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.297317:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197444.297326:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788197444.297328:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788197444.297331:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788197444.297353:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.297360:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.297367:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197444.297393:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.297421:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.297449:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.298144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776271232 00000100:00100000:2.0:1788197444.298153:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776271232 00000100:00100000:2.0:1788197444.298186:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788197444.298195:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776271232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197444.298206:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197444.298219:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143600/0x167e6c2924030031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403002a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.298243:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143600/0x167e6c2924030031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403002a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.298253:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143600/0x167e6c2924030031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403002a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.298262:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143600, rc 0) 00000100:00100000:2.0:1788197444.298304:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776271232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.298310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788197444.298404:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788197444.298429:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.298437:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197444.298487:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.298514:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.298541:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.298703:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776271360 00000100:00100000:2.0:1788197444.298708:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776271360 00000100:00100000:2.0:1788197444.298726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788197444.298732:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776271360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.299357:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776271360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 623us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.299371:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788197444.299526:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.299563:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788197444.299730:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197444.299790:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.300534:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776271488 00000100:00100000:0.0:1788197444.300542:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776271488 00000100:00100000:0.0:1788197444.300733:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788197444.300743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776271488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197444.301017:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776271488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197444.301234:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788197444.301338:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197444.301868:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8486:1875060776271616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197444.301924:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.301958:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197444.302199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776271616 00000100:00100000:2.0:1788197444.302206:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776271616 00000100:00100000:2.0:1788197444.302241:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788197444.302249:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8486:x1875060776271616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197444.302517:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8486:x1875060776271616:12345-0@lo:502:llog_process_th.0 Request processed in 267us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197444.302524:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788197444.302711:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8486:1875060776271616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788197444.302740:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197444.302750:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197444.302752:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788197444.302759:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788197444.302784:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8486:1875060776271744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197444.303163:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197444.303231:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197444.303268:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776271744 00000100:00100000:0.0:1788197444.303273:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776271744 00000100:00100000:0.0:1788197444.303338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788197444.303346:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8486:x1875060776271744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197444.303708:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8486:x1875060776271744:12345-0@lo:502:llog_process_th.0 Request processed in 362us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197444.303716:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788197444.303810:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8486:1875060776271744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788197444.305817:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788197444.306193:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197444.306198:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788197444.306204:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788197444.306400:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788197444.306423:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788197444.306434:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.306445:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197444.306456:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788197444.306458:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c70623b370 from 1 10000000:01000000:2.0:1788197444.306461:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788197444.306499:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.306507:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.306516:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197444.306542:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.306747:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.306798:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70940ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788197444.306969:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776271872 00000100:00100000:1.0:1788197444.306976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776271872 00000100:00100000:1.0:1788197444.307017:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788197444.307101:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776271872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788197444.307116:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197444.307132:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701387c00/0x167e6c292403003f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924030038 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.307159:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701387c00/0x167e6c292403003f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924030038 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.307179:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701387c00/0x167e6c292403003f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030038 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197444.307189:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387c00, rc 0) 00000100:00100000:1.0:1788197444.307233:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776271872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197444.307240:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788197444.307408:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776271872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197444.307422:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403003f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.307432:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403003f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197444.307486:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776272000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197444.307514:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197444.307543:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70940ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197444.307727:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776272000 00000100:00100000:3.0:1788197444.307732:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776272000 00000100:00100000:3.0:1788197444.307756:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788197444.307763:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776272000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197444.308560:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776272000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 791us (1040us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788197444.308696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788197444.309338:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776272000:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788197444.309385:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788197444.309395:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403003f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197444.309404:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403003f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197445.229983:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197445.550644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197445.551210:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272320 00000100:00100000:1.0:1788197445.551220:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272320 00000100:00100000:1.0:1788197445.551279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 164 00000100:00100000:1.0:1788197445.551290:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+8:5600:x1875060755272320:12345-192.168.206.40@tcp:101: 00010000:00010000:1.0:1788197445.551306:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197445.551335:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701386c00/0x167e6c2924030046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5674 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197445.551375:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701386c00/0x167e6c2924030046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5674 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197445.551387:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701386c00/0x167e6c2924030046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5674 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197445.551397:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386c00, rc 0) 00000100:00100000:1.0:1788197445.551671:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+9:5600:x1875060755272320:12345-192.168.206.40@tcp:101: Request processed in 381us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197445.551678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 164 00000100:00100000:3.0:1788197445.559241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197445.560324:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272448 00000100:00100000:0.0:1788197445.560336:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272448 00000100:00100000:0.0:1788197445.560449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 165 00000100:00100000:0.0:1788197445.560460:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+9:5600:x1875060755272448:12345-192.168.206.40@tcp:501: 00000100:00100000:0.0:1788197445.560787:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+9:5600:x1875060755272448:12345-192.168.206.40@tcp:501: Request processed in 326us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197445.560795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 165 00000100:00100000:1.0:1788197445.565163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197445.565302:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272576 00000100:00100000:0.0:1788197445.565312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272576 00000100:00100000:0.0:1788197445.565376:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00100000:0.0:1788197445.565385:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+9:5600:x1875060755272576:12345-192.168.206.40@tcp:503: 00000100:00100000:0.0:1788197445.566199:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+9:5600:x1875060755272576:12345-192.168.206.40@tcp:503: Request processed in 811us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197445.566209:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00100000:1.0:1788197445.575465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197445.575997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272704 00000100:00100000:0.0:1788197445.576009:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272704 00000100:00100000:0.0:1788197445.576070:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00100000:0.0:1788197445.576080:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+9:6078:x1875060755272704:12345-192.168.206.40@tcp:502: 00000100:00100000:0.0:1788197445.576382:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+9:6078:x1875060755272704:12345-192.168.206.40@tcp:502: Request processed in 302us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197445.576390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00100000:3.0:1788197445.584915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197445.585693:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272832 00000100:00100000:0.0:1788197445.585705:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272832 00000100:00100000:0.0:1788197445.585768:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 168 00000100:00100000:0.0:1788197445.585778:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+9:6078:x1875060755272832:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197445.586094:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+9:6078:x1875060755272832:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 315us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197445.586110:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 168 00000100:00100000:1.0:1788197445.602264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197445.604409:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755272960 00000100:00100000:3.0:1788197445.604486:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755272960 00000100:00100000:2.0:1788197445.604714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 169 00000100:00100000:2.0:1788197445.604725:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+9:5600:x1875060755272960:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197445.604741:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197445.604758:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142600/0x167e6c292403004d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d567b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197445.604805:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142600/0x167e6c292403004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d567b expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197445.604816:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142600/0x167e6c292403004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d567b expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197445.604977:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142600, rc 0) 00000100:00100000:2.0:1788197445.605041:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755272960:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 318us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197445.605048:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 169 00000100:00100000:3.0:1788197445.610544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197445.610643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273088 00000100:00100000:1.0:1788197445.610653:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273088 00000100:00100000:1.0:1788197445.610883:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 170 00000100:00100000:1.0:1788197445.610896:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755273088:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197445.611185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755273088:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 291us (651us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788197445.611194:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 170 00010000:00010000:0.0:1788197446.255998:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197446.511642:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776272512:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.511706:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197446.511757:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788197446.511764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776272128:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.511788:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197446.511807:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776272640:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.511867:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197446.511899:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776272256:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.511919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197446.511933:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776272768:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.511950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197446.511964:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197446.511968:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776272384:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.511984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197446.512017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776272640 00000100:00100000:2.0:1788197446.512023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776272640 00000100:00100000:2.0:1788197446.512066:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776272256 00000100:00100000:2.0:1788197446.512069:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776272256 00000100:00100000:2.0:1788197446.512079:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776272384 00000100:00100000:2.0:1788197446.512081:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776272384 00000100:00100000:2.0:1788197446.512095:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788197446.512102:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776272640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.512145:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776272640:12345-0@lo:400:kworker.0 Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.512152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788197446.512165:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788197446.512170:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776272256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.512192:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776272256:12345-0@lo:400:kworker.0 Request processed in 22us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.512198:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788197446.512206:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788197446.512212:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776272384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.512231:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776272384:12345-0@lo:400:kworker.0 Request processed in 19us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.512236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788197446.512254:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776272512 00000100:00100000:2.0:1788197446.512256:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776272512 00000100:00100000:2.0:1788197446.512276:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776272768 00000100:00100000:2.0:1788197446.512278:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776272768 00000100:00100000:2.0:1788197446.512293:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197446.512299:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776272512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.512324:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776272512:12345-0@lo:400:kworker.0 Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.512335:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197446.512345:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197446.512349:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776272768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.512387:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776272768:12345-0@lo:400:kworker.0 Request processed in 37us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.512393:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197446.512425:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776272384:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.512446:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776272256:0@lo:400:kworker.0 00010000:00080000:2.0:1788197446.512457:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7057a3b80 x1875060776272768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197446.512467:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776272768:0@lo:400:kworker.0 00000100:00100000:2.0:1788197446.512493:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776272640:0@lo:400:kworker.0 00010000:00080000:2.0:1788197446.512501:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7057a2680 x1875060776272512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197446.512508:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776272512:0@lo:400:kworker.0 00000100:00100000:0.0:1788197446.514667:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776272128 00000100:00100000:0.0:1788197446.514680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776272128 00000100:00100000:0.0:1788197446.514722:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788197446.514731:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776272128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197446.514805:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776272128:12345-0@lo:400:kworker.0 Request processed in 74us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197446.514811:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1788197446.514861:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197446.514868:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197446.514870:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197446.516544:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776272128:0@lo:400:kworker.0 00000020:00000080:2.0:1788197446.879733:0:8523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4af9af90 20000000:00000080:2.0:1788197446.879748:0:8523:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c737194400 uarg=0000000000000000 20000000:01000000:2.0:1788197446.879782:0:8523:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788197446.879787:0:8523:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788197446.880077:0:8523:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788197446.885035:0:8524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788197446.885224:0:8523:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788197446.890325:0:8523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788197446.890498:0:8523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788197446.890558:0:8523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788197446.890577:0:8523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788197446.890600:0:8523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890619:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700031200/0x167e6c292402fdc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890626:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402fe24 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890632:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292402feef expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890641:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890648:0:8523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890698:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890715:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 9 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197446.890731:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776272896:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197446.890862:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402feef expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890871:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402feef expref: 18 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197446.890880:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776273024:0@lo:104: 00000100:00100000:1.0:1788197446.890920:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197446.890976:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fe24 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.890985:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fe24 expref: 18 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197446.890994:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776273152:0@lo:104: 00000100:00100000:1.0:1788197446.891020:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197446.891040:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700031200/0x167e6c292402fdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.891048:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700031200/0x167e6c292402fdc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 18 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197446.891069:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776273280:0@lo:104: 00000100:00100000:1.0:1788197446.891088:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788197446.891143:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788197446.891162:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197446.891179:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273024 00000100:00100000:2.0:1788197446.891186:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273024 00000100:00100000:2.0:1788197446.891218:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273152 00000100:00100000:2.0:1788197446.891221:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273152 00000100:00100000:2.0:1788197446.891237:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273280 00000100:00100000:2.0:1788197446.891240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273280 00000100:00100000:2.0:1788197446.891252:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788197446.891260:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:8523:x1875060776273024:12345-0@lo:104: 00010000:00010000:2.0:1788197446.891273:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.891330:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197446.891336:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:8523:x1875060776273024:12345-0@lo:104: Request processed in 77us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.891342:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788197446.891367:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788197446.891373:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788197446.891374:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:8523:x1875060776273152:12345-0@lo:104: 00000100:00100000:3.0:1788197446.891380:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788197446.891382:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.891422:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788197446.891427:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74106ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:8523:x1875060776273152:12345-0@lo:104: Request processed in 54us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.891432:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788197446.891443:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776273024:0@lo:104: 00000100:00100000:1.0:1788197446.891451:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776273152:0@lo:104: 00000100:00100000:2.0:1788197446.891459:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788197446.891465:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:8523:x1875060776273280:12345-0@lo:104: 00010000:00010000:2.0:1788197446.891473:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891486:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197446.891492:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891498:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7000 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197446.891502:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891511:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.891512:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788197446.891517:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:8523:x1875060776273280:12345-0@lo:104: Request processed in 53us (354us total) trans 0 rc 0/0 10000000:00010000:3.0:1788197446.891519:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197446.891523:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:3.0:1788197446.891535:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788197446.891537:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197446.891562:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891569:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197446.891596:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891603:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c292402feef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fef6 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891616:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197446.891619:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891624:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701387400 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197446.891627:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891633:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197446.891638:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197446.891643:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788197446.891658:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891664:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197446.891683:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197446.891687:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776273408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788197446.891690:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c701387400/0x167e6c292402fdc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fdc9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197446.891700:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197446.891702:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197446.891703:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197446.891716:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776273536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788197446.892758:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197446.893050:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776273280:0@lo:104: 00000100:00100000:0.0:1788197446.894098:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273536 00000100:00100000:0.0:1788197446.894111:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273536 00010000:00010000:0.0:1788197446.894161:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700031200/0x167e6c292402fdc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 19 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197446.894197:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788197446.894207:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776273536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788197446.894222:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197446.894228:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700031200/0x167e6c292402fdc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 19 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.894238:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700031200/0x167e6c292402fdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 19 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.894254:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700031200/0x167e6c292402fdc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fdc2 expref: 19 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.894287:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197446.894351:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3313:x1875060776273536:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197446.894369:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788197446.894491:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776273536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788197446.896757:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197446.896846:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273408 00000100:00100000:0.0:1788197446.896856:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273408 00010000:00010000:0.0:1788197446.896892:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402feef expref: 18 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197446.896930:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788197446.896939:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3312:x1875060776273408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788197446.896963:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197446.896969:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402feef expref: 18 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.896980:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402feef expref: 18 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.896997:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701386600/0x167e6c292402fef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402feef expref: 18 pid: 5833 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.897011:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197446.897066:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3312:x1875060776273408:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197446.897072:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788197446.897107:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776273408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197446.897528:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197446.897532:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197446.897534:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197446.897694:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.897703:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197446.897712:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.897721:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197446.897727:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197446.897732:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788197446.897759:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.897764:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197446.897797:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.897805:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700030800/0x167e6c292402fe24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292402fe2b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197446.897862:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197446.897864:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197446.897866:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197446.897878:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776273664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788197446.897933:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197446.898069:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273664 00000100:00100000:1.0:1788197446.898076:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273664 00010000:00010000:1.0:1788197446.898096:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe24 expref: 17 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197446.898127:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788197446.898134:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3314:x1875060776273664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197446.898153:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197446.898158:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292402fe24 expref: 17 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.898167:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292402fe24 expref: 17 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.898178:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700031000/0x167e6c292402fe2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292402fe24 expref: 17 pid: 5836 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.898190:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197446.898228:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3314:x1875060776273664:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197446.898240:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788197446.898400:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776273664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788197446.902735:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1875060776272896:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197446.902773:0:8523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197446.903313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197446.903381:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273216 00000100:00100000:0.0:1788197446.903389:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273216 00010000:00010000:0.0:1788197446.903422:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 10 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197446.903456:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:0.0:1788197446.903465:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+10:2359:x1875060755273216:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197446.903479:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197446.903484:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 10 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903495:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 10 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903512:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143a00/0x167e6c292402ffb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5643 expref: 10 pid: 5836 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903526:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903534:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903547:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903554:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903575:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903582:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903587:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701387e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197446.903591:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903599:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903635:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.903645:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197446.903694:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+9:2359:x1875060755273216:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 229us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197446.903702:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00010000:00010000:1.0:1788197446.903791:0:8523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.903799:0:8523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197446.903805:0:8523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701387e00/0x167e6c2924030054 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197446.916630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197446.919878:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273344 00000100:00100000:0.0:1788197446.919893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273344 00000100:00100000:0.0:1788197446.919948:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:0.0:1788197446.919959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+9:5600:x1875060755273344:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197446.919975:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197446.919993:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5682 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.920021:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.920041:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197446.920050:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031600, rc 0) 00000100:00100000:0.0:1788197446.920106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755273344:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 149us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197446.920113:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:1.0:1788197446.933618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197446.933759:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273472 00000100:00100000:2.0:1788197446.933768:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273472 00000100:00100000:2.0:1788197446.933842:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:2.0:1788197446.933854:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755273472:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197446.934138:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755273472:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 286us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.934147:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:2.0:1788197446.942581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197446.942658:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273600 00000100:00100000:3.0:1788197446.942667:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273600 00000100:00100000:3.0:1788197446.942718:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:3.0:1788197446.942729:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755273600:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197446.942996:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:5600:x1875060755273600:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 268us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197446.943006:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:2.0:1788197446.950921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197446.951615:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273728 00000100:00100000:0.0:1788197446.951626:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273728 00000100:00100000:0.0:1788197446.951689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:0.0:1788197446.951699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:6098:x1875060755273728:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197446.951978:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:6098:x1875060755273728:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 280us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197446.951986:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:0.0:1788197446.959456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197446.959654:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273856 00000100:00100000:2.0:1788197446.959663:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273856 00000100:00100000:2.0:1788197446.959716:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:2.0:1788197446.959726:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:6098:x1875060755273856:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788197446.960242:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:6098:x1875060755273856:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 514us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197446.960252:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:0.0:1788197447.022076:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788197447.022101:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776273792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197447.022172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197447.022222:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273792 00000100:00100000:1.0:1788197447.022231:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273792 00000100:00100000:1.0:1788197447.022295:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788197447.022307:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776273792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788197447.022347:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197447.022428:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776273792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197447.022437:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788197447.022504:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414cd880 x1875060776273792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197447.022527:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776273792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197447.278121:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197447.537197:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197447.537277:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197447.537389:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776273920 00000100:00100000:3.0:1788197447.537396:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776273920 00000100:00100000:3.0:1788197447.537441:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788197447.537451:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776273920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197447.537552:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197447.537614:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776273920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197447.537622:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788197447.537668:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c283800 x1875060776273920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197447.537688:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776273920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197448.303682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197448.303726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197448.303796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197448.303854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197448.304552:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755274112 00000100:00100000:2.0:1788197448.304563:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755274112 00000100:00100000:2.0:1788197448.306257:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:2.0:1788197448.306271:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755274112:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197448.306362:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755274112:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 83us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197448.306370:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:2.0:1788197448.306400:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755274368 00000100:00100000:2.0:1788197448.306405:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755274368 00000100:00100000:0.0:1788197448.309002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755273984 00000100:00100000:0.0:1788197448.309020:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755273984 00000100:00100000:0.0:1788197448.309081:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 177 00000100:00100000:0.0:1788197448.309092:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755273984:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197448.309168:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755273984:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (5371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.309176:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 177 00000100:00080000:3.0:1788197448.310754:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788197448.310764:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197448.310889:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755274240 00000100:00100000:0.0:1788197448.310900:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755274240 00000100:00100000:0.0:1788197448.310969:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1788197448.310979:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274240:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197448.311047:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274240:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 70us (7193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.311055:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00080000:3.0:1788197448.311292:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788197448.311650:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:2.0:1788197448.311660:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274368:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197448.311705:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274368:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 47us (7978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197448.311712:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00010000:00010000:1.0:1788197448.319918:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788197448.365943:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788197448.365952:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c736929000 from 4 10000000:01000000:2.0:1788197448.365956:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788197448.366008:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197448.366020:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197448.366032:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197448.366071:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.366144:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197448.366204:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7370770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.366259:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274048 00000100:00100000:0.0:1788197448.366268:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274048 00000100:00100000:0.0:1788197448.366322:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788197448.366332:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776274048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197448.366345:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197448.366370:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924030062 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.366392:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924030062 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.366401:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030062 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.366410:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030c00, rc 0) 00000100:00100000:0.0:1788197448.366458:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776274048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.366465:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788197448.366533:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197448.366547:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197448.366556:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197448.366606:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.366631:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197448.366651:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7370770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.366687:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274176 00000100:00100000:0.0:1788197448.366692:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274176 00000100:00100000:0.0:1788197448.366719:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788197448.366735:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776274176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.366989:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776274176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.366997:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788197448.367459:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.367495:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.367537:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197448.367571:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7370770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.367620:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274304 00000100:00100000:0.0:1788197448.367625:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274304 00000100:00100000:0.0:1788197448.367658:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788197448.367666:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776274304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.367808:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776274304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.367816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788197448.367943:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197448.382215:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8582:1875060776274432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197448.382306:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197448.382373:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.382546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274432 00000100:00100000:0.0:1788197448.382554:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274432 00000100:00100000:0.0:1788197448.382609:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788197448.382618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8582:x1875060776274432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197448.382887:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8582:x1875060776274432:12345-0@lo:502:llog_process_th.0 Request processed in 269us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.382895:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788197448.383050:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8582:1875060776274432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788197448.383084:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197448.383092:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197448.383095:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788197448.383101:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c736929000 00000020:00000080:3.0:1788197448.383104:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788197448.383184:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8582:1875060776274560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197448.383221:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197448.383245:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197448.383286:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274560 00000100:00100000:1.0:1788197448.383290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274560 00000100:00100000:1.0:1788197448.383325:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788197448.383333:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8582:x1875060776274560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197448.383482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:8582:x1875060776274560:12345-0@lo:502:llog_process_th.0 Request processed in 150us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197448.383498:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788197448.383535:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8582:1875060776274560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788197448.383555:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788197448.383560:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197448.383562:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788197448.383566:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788197448.389818:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788197448.389873:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197448.389884:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.389897:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197448.389908:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788197448.389919:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c70f634000 from 4 10000000:01000000:0.0:1788197448.389922:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197448.389959:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.389968:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.389979:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197448.390010:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.390087:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197448.390137:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.390158:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274688 00000100:00100000:0.0:1788197448.390164:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274688 00000100:00100000:0.0:1788197448.390206:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788197448.390216:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776274688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197448.390230:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197448.390243:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924030070 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.390268:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.390279:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.390288:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031800, rc 0) 00000100:00100000:0.0:1788197448.390327:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776274688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.390339:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788197448.390400:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197448.390413:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.390421:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197448.390469:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.390494:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197448.390511:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.390524:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274816 00000100:00100000:0.0:1788197448.390527:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274816 00000100:00100000:0.0:1788197448.390552:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788197448.390558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776274816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.397509:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776274816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6939us (7003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.397523:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788197448.404581:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197448.404664:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197448.404734:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197448.404779:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.404922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776274944 00000100:00100000:0.0:1788197448.404929:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776274944 00000100:00100000:0.0:1788197448.404971:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788197448.404981:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776274944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.405166:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776274944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.405174:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788197448.405232:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776274944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788197448.410033:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8586:1875060776275072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197448.410109:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197448.410148:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.413248:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275072 00000100:00100000:0.0:1788197448.413262:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275072 00000100:00100000:0.0:1788197448.413316:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788197448.413326:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8586:x1875060776275072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197448.413639:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8586:x1875060776275072:12345-0@lo:502:llog_process_th.0 Request processed in 313us (3529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.413647:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788197448.413920:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8586:1875060776275072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788197448.413960:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788197448.413972:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197448.413975:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788197448.413982:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c70f634000 00000020:00000080:0.0:1788197448.413984:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788197448.414072:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8586:1875060776275200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197448.414121:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197448.414144:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197448.417958:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275200 00000100:00100000:2.0:1788197448.417976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275200 00000100:00100000:2.0:1788197448.418046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788197448.418057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8586:x1875060776275200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197448.418335:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:8586:x1875060776275200:12345-0@lo:502:llog_process_th.0 Request processed in 278us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197448.418370:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788197448.418669:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8586:1875060776275200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788197448.418703:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197448.418712:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197448.418714:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788197448.418720:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788197448.418865:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788197448.418881:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197448.418890:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.418915:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197448.418926:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788197448.418929:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c706bce800 from 4 10000000:01000000:0.0:1788197448.418932:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197448.418957:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.418965:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.418974:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197448.418992:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776275328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.419029:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197448.419059:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197448.419073:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275328 00000100:00100000:0.0:1788197448.419079:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275328 00000100:00100000:0.0:1788197448.419111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788197448.419119:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776275328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197448.419130:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197448.419141:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403007e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.419163:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403007e expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.419184:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403007e expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.419193:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030800, rc 0) 00000100:00100000:0.0:1788197448.419224:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776275328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197448.419230:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788197448.419259:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776275328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197448.419270:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.419278:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197448.419319:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776275456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.420654:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197448.420686:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275456 00000100:00100000:2.0:1788197448.420694:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275456 00000100:00100000:0.0:1788197448.420700:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197448.420737:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788197448.420744:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776275456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.421033:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776275456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197448.421040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788197448.421096:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776275456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.421137:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776275584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.421181:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197448.421201:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737077600 going to sleep for 11 seconds 00000100:00100000:2.0:1788197448.421213:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275584 00000100:00100000:2.0:1788197448.421217:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275584 00000100:00100000:2.0:1788197448.421239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788197448.421245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776275584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197448.421390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776275584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197448.421397:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788197448.421440:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776275584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197448.426224:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8588:1875060776275712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197448.426309:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197448.426365:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197448.426525:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275712 00000100:00100000:2.0:1788197448.426533:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275712 00000100:00100000:2.0:1788197448.430001:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788197448.430741:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:8588:x1875060776275712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197448.431267:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:8588:x1875060776275712:12345-0@lo:502:llog_process_th.0 Request processed in 539us (4955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197448.431276:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788197448.435929:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8588:1875060776275712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788197448.435979:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788197448.435993:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197448.435996:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788197448.436004:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c706bce800 00000020:00000080:0.0:1788197448.436013:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788197448.436523:0:8588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8588:1875060776275840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197448.436592:0:8588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197448.436747:0:8588:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197448.437601:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275840 00000100:00100000:3.0:1788197448.437610:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275840 00000100:00100000:3.0:1788197448.437655:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788197448.437665:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:8588:x1875060776275840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197448.437912:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:8588:x1875060776275840:12345-0@lo:502:llog_process_th.0 Request processed in 248us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197448.437920:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788197448.437995:0:8588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:8588:1875060776275840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788197448.439771:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197448.439782:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197448.439784:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788197448.439788:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788197448.442201:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788197448.442235:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197448.442246:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197448.442259:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197449.328236:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197450.351533:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197451.379256:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197451.629995:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776275968:0@lo:400:kworker.0 00000100:00100000:1.0:1788197451.630057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197451.630381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776275968 00000100:00100000:0.0:1788197451.630390:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776275968 00000100:00100000:0.0:1788197451.630442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788197451.630452:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776275968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197451.634503:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776276096:0@lo:400:kworker.0 00000100:00100000:3.0:1788197451.634578:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197451.634717:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776275968:12345-0@lo:400:kworker.0 Request processed in 4264us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197451.634728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788197451.640730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276096 00000100:00100000:0.0:1788197451.640741:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276096 00000100:00100000:0.0:1788197451.640793:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788197451.640805:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197451.640920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776276096:12345-0@lo:400:kworker.0 Request processed in 117us (6339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197451.640927:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788197451.640982:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776276096:0@lo:400:kworker.0 00000100:00100000:0.0:1788197451.641009:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776276608:0@lo:400:kworker.0 00000100:00100000:2.0:1788197451.641010:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776276224:0@lo:400:kworker.0 00000100:00100000:2.0:1788197451.641057:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197451.641064:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197451.641087:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197451.641093:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776276352:0@lo:400:kworker.0 00000100:00100000:0.0:1788197451.641111:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788197451.641118:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197451.641121:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776276480:0@lo:400:kworker.0 00000100:00100000:0.0:1788197451.641158:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197451.641160:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276224 00000100:00100000:2.0:1788197451.641166:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276224 00000100:00100000:0.0:1788197451.641198:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276608 00000100:00100000:0.0:1788197451.641203:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276608 00000100:00100000:2.0:1788197451.641211:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276480 00000100:00100000:2.0:1788197451.641216:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276480 00000100:00100000:0.0:1788197451.641245:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276352 00000100:00100000:2.0:1788197451.641251:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788197451.641251:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276352 00000100:00100000:2.0:1788197451.641262:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197451.641289:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788197451.641300:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776276608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197451.641306:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776276224:12345-0@lo:400:kworker.0 Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197451.641313:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788197451.641329:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788197451.641349:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776276480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197451.641359:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776276608:12345-0@lo:400:kworker.0 Request processed in 60us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197451.641367:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788197451.641387:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776276480:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197451.641388:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788197451.641398:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788197451.641401:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776276352:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788197451.641424:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197451.641430:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197451.641434:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197451.641441:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776276352:12345-0@lo:400:kworker.0 Request processed in 43us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197451.641449:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788197451.641485:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7057a0e00 x1875060776276352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197451.641491:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776276480:0@lo:400:kworker.0 00010000:00080000:0.0:1788197451.641506:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7057a0000 x1875060776276608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197451.641516:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776276608:0@lo:400:kworker.0 00000100:00100000:2.0:1788197451.641626:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776276352:0@lo:400:kworker.0 00000100:00100000:2.0:1788197451.641641:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776276224:0@lo:400:kworker.0 00000100:00100000:1.0:1788197451.641804:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776275968:0@lo:400:kworker.0 00000100:00100000:2.0:1788197452.148870:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776276736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197452.148943:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197452.149020:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276736 00000100:00100000:3.0:1788197452.149038:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276736 00000100:00100000:3.0:1788197452.149088:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788197452.149097:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776276736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197452.149129:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197452.149181:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776276736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197452.149189:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788197452.149244:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c1faa00 x1875060776276736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197452.149261:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776276736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788197452.397922:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197452.654001:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776276864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197452.654064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197452.654891:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276864 00000100:00100000:2.0:1788197452.654900:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276864 00000100:00100000:2.0:1788197452.654945:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788197452.654953:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776276864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788197452.654984:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197452.655032:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776276864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197452.655039:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788197452.657287:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c281880 x1875060776276864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197452.657314:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776276864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197453.423167:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197453.423396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197453.423440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197453.423464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197453.423498:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197453.423675:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755274880 00000100:00100000:2.0:1788197453.423684:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755274880 00000100:00100000:2.0:1788197453.423745:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755274752 00000100:00100000:2.0:1788197453.423749:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755274752 00000100:00100000:2.0:1788197453.423774:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1788197453.423783:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274880:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197453.423904:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274880:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 121us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197453.423924:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1788197453.423943:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1788197453.423950:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274752:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197453.423975:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755274752:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197453.423980:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1788197453.424009:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755274496 00000100:00100000:2.0:1788197453.424014:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755274496 00000100:00100000:2.0:1788197453.424038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 194 00000100:00100000:2.0:1788197453.424045:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755274496:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197453.424069:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755274496:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197453.424075:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 194 00000100:00080000:3.0:1788197453.424504:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788197453.424509:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197453.424633:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755274624 00000100:00100000:1.0:1788197453.424640:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755274624 00000100:00100000:1.0:1788197453.424696:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:1.0:1788197453.424705:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755274624:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197453.424750:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755274624:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 47us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197453.424758:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00080000:3.0:1788197453.424981:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788197454.398122:0:8825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788197454.455816:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197455.477485:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197456.494108:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197456.750147:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776277120:0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.750193:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776276992:0@lo:400:kworker.0 00000100:00100000:2.0:1788197456.750243:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776277248:0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.754699:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197456.754816:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776277504:0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.754875:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197456.754938:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776277376:0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.754967:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197456.755006:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776277376 00000100:00100000:3.0:1788197456.755013:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776277376 00000100:00100000:3.0:1788197456.755067:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788197456.755077:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776277376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197456.757662:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197456.757743:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776277504 00000100:00100000:2.0:1788197456.757751:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776277504 00000100:00100000:2.0:1788197456.757795:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776277248 00000100:00100000:2.0:1788197456.757798:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776277248 00000100:00100000:2.0:1788197456.757819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788197456.757841:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776277504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.757861:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776277376:12345-0@lo:400:kworker.0 Request processed in 2785us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197456.757870:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788197456.757880:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776277504:12345-0@lo:400:kworker.0 Request processed in 41us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197456.757886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788197456.757902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788197456.757906:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197456.757907:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776277248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788197456.757910:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788197456.757938:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414cea00 x1875060776277376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197456.757938:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776277248:12345-0@lo:400:kworker.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197456.757944:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788197456.757951:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776277376:0@lo:400:kworker.0 00000100:00100000:2.0:1788197456.757979:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776277504:0@lo:400:kworker.0 00000100:00100000:2.0:1788197456.758001:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776277248:0@lo:400:kworker.0 00000100:00100000:0.0:1788197456.761173:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197456.761277:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776277632:0@lo:400:kworker.0 00000100:00100000:0.0:1788197456.761338:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197456.764565:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776277632 00000100:00100000:3.0:1788197456.764579:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776277632 00000100:00100000:3.0:1788197456.764666:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788197456.764676:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776277632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.764764:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776277632:12345-0@lo:400:kworker.0 Request processed in 89us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197456.764772:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788197456.764795:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788197456.764852:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414cdc00 x1875060776277632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197456.764868:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776277632:0@lo:400:kworker.0 00000100:00100000:2.0:1788197456.765274:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776277120 00000100:00100000:2.0:1788197456.765281:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776277120 00000100:00100000:3.0:1788197456.765401:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788197456.765409:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776277120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.765460:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776277120:12345-0@lo:400:kworker.0 Request processed in 52us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197456.765613:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776277120:0@lo:400:kworker.0 00000100:00100000:3.0:1788197456.765695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788197456.766455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776276992 00000100:00100000:1.0:1788197456.766462:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776276992 00000100:00100000:1.0:1788197456.766503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788197456.766520:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776276992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197456.766601:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776276992:12345-0@lo:400:kworker.0 Request processed in 90us (11909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197456.766609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788197456.766737:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776276992:0@lo:400:kworker.0 00000100:00100000:1.0:1788197457.263024:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788197457.263045:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776277760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197457.263110:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197457.263213:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776277760 00000100:00100000:2.0:1788197457.263220:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776277760 00000100:00100000:2.0:1788197457.263262:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788197457.263270:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776277760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788197457.263300:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197457.263360:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776277760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197457.263367:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788197457.263443:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414cf800 x1875060776277760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197457.263467:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776277760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788197457.518059:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197457.774423:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197457.774444:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776277888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197457.774506:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197457.774568:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776277888 00000100:00100000:0.0:1788197457.774574:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776277888 00000100:00100000:0.0:1788197457.774616:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788197457.774626:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776277888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197457.774656:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197457.774700:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776277888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197457.774707:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788197457.774745:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c1f8380 x1875060776277888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197457.774764:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776277888:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788197458.541458:0:9070:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing yml_node 00010000:00010000:1.0:1788197458.543001:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197458.548153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197458.548191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197458.548219:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275008 00000100:00100000:0.0:1788197458.548228:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275008 00000100:00100000:0.0:1788197458.548273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:0.0:1788197458.548447:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755275008:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197458.549679:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755275008:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 1231us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197458.549689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:0.0:1788197458.549734:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275136 00000100:00100000:0.0:1788197458.549741:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275136 00000100:00100000:0.0:1788197458.549787:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:0.0:1788197458.549795:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755275136:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197458.549855:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755275136:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 61us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197458.549861:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00080000:0.0:1788197458.549880:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197458.565514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197458.565556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197458.565588:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275264 00000100:00100000:0.0:1788197458.565598:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275264 00000100:00100000:0.0:1788197458.565652:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275392 00000100:00100000:0.0:1788197458.565655:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275392 00000100:00100000:0.0:1788197458.565678:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1788197458.565687:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2356:x1875060755275264:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:0.0:1788197458.565722:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ffc1 00000100:00080000:0.0:1788197458.565732:0:6698:0:(import.c:65:import_set_state_nolock()) ffff93c741727000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788197458.565771:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788197458.566415:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+2:2356:x1875060755275264:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 725us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197458.566425:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1788197458.566443:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1788197458.566459:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2356:x1875060755275392:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:0.0:1788197458.566476:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ffc8 00000100:00080000:0.0:1788197458.566482:0:6698:0:(import.c:65:import_set_state_nolock()) ffff93c741720800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788197458.566505:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788197458.566701:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+2:2356:x1875060755275392:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 244us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197458.566708:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00010000:00010000:0.0:1788197458.566779:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788197458.566787:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197458.566791:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788197458.567459:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197459.566133:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197460.590123:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197461.614057:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197461.870259:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776278400:0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.870422:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776278144:0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.870475:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197461.870527:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776278656:0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.870552:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197461.870582:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788197461.870588:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776278016:0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.870613:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197461.870631:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776278528:0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.870669:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197461.870719:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278656 00000100:00100000:0.0:1788197461.870727:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278656 00000100:00100000:0.0:1788197461.870776:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788197461.870785:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776278656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.870866:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776278656:12345-0@lo:400:kworker.0 Request processed in 81us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197461.870883:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788197461.870908:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278016 00000100:00100000:0.0:1788197461.870912:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278016 00000100:00100000:0.0:1788197461.870936:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788197461.870942:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776278016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.870973:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776278016:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197461.870979:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1788197461.871002:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788197461.871054:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776278016:0@lo:400:kworker.0 00010000:00080000:0.0:1788197461.871069:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c707c01f80 x1875060776278656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197461.871079:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776278656:0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.871117:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278144 00000100:00100000:0.0:1788197461.871121:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278144 00000100:00100000:0.0:1788197461.871144:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278528 00000100:00100000:0.0:1788197461.871147:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278528 00000100:00100000:0.0:1788197461.871170:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788197461.871176:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776278144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.871210:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776278144:12345-0@lo:400:kworker.0 Request processed in 34us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197461.871216:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788197461.871228:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788197461.871234:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776278528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.871260:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776278528:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197461.871272:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788197461.871304:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197461.871321:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776278528:0@lo:400:kworker.0 00000100:00100000:0.0:1788197461.871331:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776278144:0@lo:400:kworker.0 00000100:00100000:1.0:1788197461.871546:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776278272:0@lo:400:kworker.0 00000100:00100000:1.0:1788197461.871579:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197461.872903:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278272 00000100:00100000:3.0:1788197461.872912:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278272 00000100:00100000:3.0:1788197461.872964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788197461.872972:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776278272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197461.873042:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776278272:12345-0@lo:400:kworker.0 Request processed in 71us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197461.873049:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788197461.873071:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197461.873098:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776278272:0@lo:400:kworker.0 00000100:00100000:2.0:1788197461.873340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197461.873623:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278400 00000100:00100000:3.0:1788197461.873628:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278400 00000100:00100000:3.0:1788197461.873672:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788197461.873678:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776278400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197461.873723:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776278400:12345-0@lo:400:kworker.0 Request processed in 45us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197461.873729:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788197461.873813:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788197461.873879:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7057a2680 x1875060776278400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197461.873891:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776278400:0@lo:400:kworker.0 00000100:00100000:2.0:1788197462.383135:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197462.383167:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776278784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197462.383255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197462.383449:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278784 00000100:00100000:0.0:1788197462.383459:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278784 00000100:00100000:0.0:1788197462.383520:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788197462.383531:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776278784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197462.383570:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197462.383636:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776278784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197462.383645:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788197462.383731:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414cdf80 x1875060776278784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197462.383752:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776278784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788197462.647135:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197462.900759:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197462.900781:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776278912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197462.900875:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197462.901327:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776278912 00000100:00100000:0.0:1788197462.901336:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776278912 00000100:00100000:0.0:1788197462.901389:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788197462.901399:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776278912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197462.901430:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197462.901479:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776278912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197462.901487:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788197462.901522:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70838a680 x1875060776278912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197462.901540:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776278912:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788197462.974962:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:1.0:1788197462.974971:0:6721:0:(genops.c:885:class_export_put()) final put ffff93c741725000/87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:1.0:1788197462.976947:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c741725000/87c79f47-cb13-4c8a-942c-8f23eb455b39 for lustre-OST0000 00000020:00000080:1.0:1788197462.977007:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c741727000 for lustre-OST0000 00000001:00100000:0.0:1788197462.989583:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:0.0:1788197462.989604:0:7661:0:(genops.c:885:class_export_put()) final put ffff93c741721800/87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:2.0:1788197462.989872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c741721800/87c79f47-cb13-4c8a-942c-8f23eb455b39 for lustre-OST0001 00000020:00000080:2.0:1788197462.990022:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c741720800 for lustre-OST0001 00000001:02000400:3.0:1788197463.319284:0:9262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:1.0:1788197463.662509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197463.662567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197463.662602:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275648 00000100:00100000:1.0:1788197463.662611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275648 00000100:00100000:1.0:1788197463.662670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:1.0:1788197463.662680:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755275648:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197463.662750:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755275648:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 71us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197463.662758:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00080000:1.0:1788197463.662778:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197463.663775:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275520 00000100:00100000:3.0:1788197463.663785:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275520 00000100:00100000:3.0:1788197463.663865:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 198 00000100:00100000:3.0:1788197463.663887:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755275520:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197463.663938:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755275520:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 65us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197463.663944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 198 00010000:00010000:1.0:1788197463.674673:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197464.686107:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197465.714570:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788197466.053539:0:9360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:3.0:1788197466.734158:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197466.990699:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776279168:0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.990793:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197466.990869:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776279680:0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.991019:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197466.991532:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788197466.991541:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776279040:0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.991574:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197466.991598:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776279552:0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.991621:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197466.991654:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776279296:0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.991678:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197466.991699:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197466.991704:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776279424:0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.991726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197466.991756:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279168 00000100:00100000:3.0:1788197466.991763:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279168 00000100:00100000:3.0:1788197466.991808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279552 00000100:00100000:3.0:1788197466.991811:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279552 00000100:00100000:3.0:1788197466.991866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279296 00000100:00100000:3.0:1788197466.991869:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279296 00000100:00100000:3.0:1788197466.991904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788197466.991912:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776279168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.991964:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776279168:12345-0@lo:400:kworker.0 Request processed in 53us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197466.991971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788197466.991989:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788197466.991995:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776279552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197466.992022:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776279552:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197466.992028:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788197466.992171:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279040 00000100:00100000:0.0:1788197466.992176:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279040 00000100:00100000:0.0:1788197466.992205:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788197466.992212:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776279040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197466.992243:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776279040:12345-0@lo:400:kworker.0 Request processed in 32us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197466.992261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788197466.992292:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788197466.992299:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776279296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197466.992332:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776279296:12345-0@lo:400:kworker.0 Request processed in 33us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197466.992338:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788197466.992357:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279680 00000100:00100000:0.0:1788197466.992657:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279680 00000100:00100000:0.0:1788197466.993011:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279424 00000100:00100000:0.0:1788197466.993015:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279424 00000100:00100000:0.0:1788197466.993263:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788197466.993272:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776279680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197466.993320:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776279680:12345-0@lo:400:kworker.0 Request processed in 50us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197466.993327:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788197466.993339:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788197466.993345:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776279424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197466.993389:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776279424:12345-0@lo:400:kworker.0 Request processed in 44us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197466.993411:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788197466.993656:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788197466.993662:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788197466.993665:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197466.994796:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776279040:0@lo:400:kworker.0 00010000:00080000:2.0:1788197467.000022:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c282d80 x1875060776279424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197467.000055:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776279424:0@lo:400:kworker.0 00000100:00100000:2.0:1788197467.000072:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776279296:0@lo:400:kworker.0 00000100:00100000:3.0:1788197467.003566:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776279552:0@lo:400:kworker.0 00000100:00100000:3.0:1788197467.003696:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776279168:0@lo:400:kworker.0 00010000:00080000:3.0:1788197467.003710:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480f480 x1875060776279680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197467.003721:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776279680:0@lo:400:kworker.0 00000100:00100000:2.0:1788197467.502048:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776279808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197467.502129:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197467.503904:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279808 00000100:00100000:0.0:1788197467.503917:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279808 00000100:00100000:0.0:1788197467.503983:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788197467.503995:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776279808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197467.504030:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197467.504103:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776279808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197467.504111:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788197467.504291:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414ced80 x1875060776279808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197467.504311:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776279808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788197467.758488:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197468.015003:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74179b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776279936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197468.015075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197468.023179:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776279936 00000100:00100000:0.0:1788197468.023193:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776279936 00000100:00100000:0.0:1788197468.023363:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788197468.023385:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776279936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197468.023427:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788197468.023441:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197468.024351:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776279936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 966us (9272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197468.024360:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788197468.029634:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c74179b480 x1875060776279936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197468.029663:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74179b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776279936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197468.790428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197468.790492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197468.790524:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275904 00000100:00100000:1.0:1788197468.790533:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275904 00000100:00100000:1.0:1788197468.790592:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:1.0:1788197468.790602:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755275904:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197468.790672:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755275904:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197468.790681:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00080000:1.0:1788197468.790700:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788197468.795089:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197468.795884:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755275776 00000100:00100000:0.0:1788197468.795897:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755275776 00000100:00100000:0.0:1788197468.795953:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 200 00000100:00100000:0.0:1788197468.795973:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755275776:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197468.796277:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:2358:x1875060755275776:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 314us (5858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197468.796300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 200 00000001:02000400:0.0:1788197468.872161:0:9459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:3.0:1788197469.806606:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197470.830778:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788197471.659814:0:9507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 31 13:31:08 EDT 2026 00010000:00010000:2.0:1788197471.857867:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197472.110082:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776280064:0@lo:400:kworker.0 00000100:00100000:2.0:1788197472.110158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197472.110339:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776280192:0@lo:400:kworker.0 00000100:00100000:0.0:1788197472.110375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197472.111185:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280192 00000100:00100000:3.0:1788197472.111192:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280192 00000100:00100000:3.0:1788197472.111247:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788197472.111257:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776280192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197472.111321:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776280192:12345-0@lo:400:kworker.0 Request processed in 66us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197472.111329:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788197472.111351:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776280448:0@lo:400:kworker.0 00000100:00100000:3.0:1788197472.111379:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197472.111400:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197472.111405:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776280320:0@lo:400:kworker.0 00000100:00100000:3.0:1788197472.111435:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197472.111469:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280320 00000100:00100000:3.0:1788197472.111485:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280320 00000100:00100000:3.0:1788197472.111519:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788197472.111525:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776280320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197472.111850:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280064 00000100:00100000:1.0:1788197472.111861:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280064 00000100:00100000:1.0:1788197472.111904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788197472.111911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197472.112499:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776280576:0@lo:400:kworker.0 00000100:00100000:2.0:1788197472.118177:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280448 00000100:00100000:2.0:1788197472.118191:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280448 00000100:00100000:2.0:1788197472.118278:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788197472.118289:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776280448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197472.118457:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776280064:12345-0@lo:400:kworker.0 Request processed in 6544us (8296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197472.118467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1788197472.118519:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788197472.118524:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197472.118548:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776280704:0@lo:400:kworker.0 00000100:00100000:1.0:1788197472.118581:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197472.118623:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776280192:0@lo:400:kworker.0 00000100:00100000:1.0:1788197472.118663:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280704 00000100:00100000:1.0:1788197472.118668:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280704 00000100:00100000:1.0:1788197472.118697:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788197472.118703:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776280704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197472.118737:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776280704:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197472.118743:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788197472.118755:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788197472.118772:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c706b3fb80 x1875060776280704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197472.118782:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776280704:0@lo:400:kworker.0 00000100:00100000:0.0:1788197472.123119:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197472.123184:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776280064:0@lo:400:kworker.0 00000100:00100000:1.0:1788197472.123274:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280576 00000100:00100000:1.0:1788197472.123281:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280576 00000100:00100000:1.0:1788197472.123342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788197472.123351:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776280576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197472.123422:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776280576:12345-0@lo:400:kworker.0 Request processed in 71us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197472.123439:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788197472.123476:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776280576:0@lo:400:kworker.0 00000100:00100000:3.0:1788197472.123633:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776280320:12345-0@lo:400:kworker.0 Request processed in 12107us (12204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197472.123642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788197472.123679:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776280320:0@lo:400:kworker.0 00000100:00100000:2.0:1788197472.125430:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776280448:12345-0@lo:400:kworker.0 Request processed in 7135us (14042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197472.125456:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788197472.125549:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788197472.125584:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c706b3ea00 x1875060776280448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197472.125597:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776280448:0@lo:400:kworker.0 00000100:00100000:3.0:1788197472.627957:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197472.627980:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776280832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197472.628053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197472.628274:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280832 00000100:00100000:0.0:1788197472.628282:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280832 00000100:00100000:0.0:1788197472.628326:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788197472.628335:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776280832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197472.628364:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197472.628405:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776280832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197472.628412:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788197472.628650:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c741799500 x1875060776280832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197472.628667:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776280832:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197472.886763:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197473.139651:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776280960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197473.139717:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197473.139791:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776280960 00000100:00100000:0.0:1788197473.139797:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776280960 00000100:00100000:0.0:1788197473.139850:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788197473.139858:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776280960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197473.139887:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197473.139923:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776280960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197473.139943:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788197473.139978:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c741799f80 x1875060776280960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197473.139994:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776280960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197473.903170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197473.903238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197473.903498:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276160 00000100:00100000:3.0:1788197473.903507:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276160 00000100:00100000:3.0:1788197473.903576:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:3.0:1788197473.903586:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755276160:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197473.903655:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755276160:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 70us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197473.903663:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00080000:1.0:1788197473.904155:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788197473.905464:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197473.906186:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276032 00000100:00100000:1.0:1788197473.906197:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276032 00000100:00100000:1.0:1788197473.906278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 202 00000100:00100000:1.0:1788197473.906288:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755276032:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197473.906357:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755276032:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 70us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197473.906364:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 202 00010000:00010000:2.0:1788197474.926304:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197475.966361:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197476.983598:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197477.236764:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776281344:0@lo:400:kworker.0 00000100:00100000:1.0:1788197477.236851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197477.236914:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197477.236921:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776281472:0@lo:400:kworker.0 00000100:00100000:1.0:1788197477.236947:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197477.236998:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281344 00000100:00100000:1.0:1788197477.237005:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281344 00000100:00100000:1.0:1788197477.237056:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788197477.237065:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776281344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197477.237114:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776281344:12345-0@lo:400:kworker.0 Request processed in 49us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197477.237149:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788197477.237172:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281472 00000100:00100000:1.0:1788197477.237176:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281472 00000100:00100000:1.0:1788197477.237215:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788197477.237222:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776281472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197477.237252:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776281472:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197477.237258:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788197477.237274:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788197477.237278:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788197477.237308:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414cca80 x1875060776281472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197477.237320:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776281472:0@lo:400:kworker.0 00000100:00100000:1.0:1788197477.237331:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776281344:0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.237572:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776281088:0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.237605:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197477.237637:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776281600:0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.237658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197477.237678:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788197477.237684:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776281216:0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.237702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197477.237719:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776281728:0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.237754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197477.237782:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281600 00000100:00100000:2.0:1788197477.237786:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281600 00000100:00100000:2.0:1788197477.237814:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281216 00000100:00100000:2.0:1788197477.237816:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281216 00000100:00100000:2.0:1788197477.237850:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788197477.237857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776281600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.237906:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776281600:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197477.237912:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788197477.237924:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788197477.237930:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776281216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.237957:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776281216:12345-0@lo:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197477.237962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788197477.238001:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281728 00000100:00100000:2.0:1788197477.238004:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281728 00000100:00100000:2.0:1788197477.238028:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788197477.238034:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776281728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.238062:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776281728:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197477.238068:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788197477.238086:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197477.238089:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197477.238107:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776281216:0@lo:400:kworker.0 00010000:00080000:2.0:1788197477.238117:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414cdc00 x1875060776281728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197477.238139:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776281728:0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.238148:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776281600:0@lo:400:kworker.0 00000100:00100000:1.0:1788197477.242930:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281088 00000100:00100000:1.0:1788197477.242944:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281088 00000100:00100000:1.0:1788197477.243021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788197477.243032:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776281088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197477.243114:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776281088:12345-0@lo:400:kworker.0 Request processed in 84us (5507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197477.243121:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788197477.243452:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776281088:0@lo:400:kworker.0 00000100:00100000:2.0:1788197477.746501:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197477.746526:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776281856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197477.746583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197477.746647:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281856 00000100:00100000:2.0:1788197477.746653:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281856 00000100:00100000:2.0:1788197477.746694:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788197477.746703:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776281856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788197477.746741:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197477.746780:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776281856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197477.746801:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788197477.746858:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c281500 x1875060776281856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197477.746875:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776281856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788197478.017625:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197478.255916:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776281984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197478.255996:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197478.256071:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776281984 00000100:00100000:0.0:1788197478.256079:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776281984 00000100:00100000:0.0:1788197478.256123:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788197478.256131:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776281984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197478.256161:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197478.256215:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776281984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197478.256222:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788197478.256259:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c741799f80 x1875060776281984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197478.256276:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776281984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197479.025230:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197479.027177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197479.027226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197479.027253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276288 00000100:00100000:0.0:1788197479.027262:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276288 00000100:00100000:0.0:1788197479.027308:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 204 00000100:00100000:0.0:1788197479.027317:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755276288:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197479.027377:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755276288:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197479.027390:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 204 00000100:00100000:3.0:1788197479.038210:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276416 00000100:00100000:3.0:1788197479.038223:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276416 00000100:00100000:3.0:1788197479.038400:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:3.0:1788197479.038411:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755276416:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197479.038516:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755276416:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 92us (11332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197479.038523:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00080000:1.0:1788197479.038870:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788197480.045928:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197481.070078:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197482.094521:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197482.350137:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776282496:0@lo:400:kworker.0 00000100:00100000:3.0:1788197482.350213:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776282240:0@lo:400:kworker.0 00000100:00100000:2.0:1788197482.350214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197482.350247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197482.350304:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776282368:0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.350342:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197482.350395:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776282240 00000100:00100000:1.0:1788197482.350403:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776282240 00000100:00100000:1.0:1788197482.350440:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776282368 00000100:00100000:1.0:1788197482.350444:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776282368 00000100:00100000:1.0:1788197482.350472:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788197482.350480:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776282240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.350524:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776282240:12345-0@lo:400:kworker.0 Request processed in 44us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197482.350531:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788197482.350546:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788197482.350562:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776282368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.350593:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776282368:12345-0@lo:400:kworker.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197482.350599:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788197482.350615:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197482.350642:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776282368:0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.350696:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776282496 00000100:00100000:1.0:1788197482.350700:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776282496 00000100:00100000:1.0:1788197482.350730:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788197482.350737:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776282496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.350768:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776282496:12345-0@lo:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197482.350773:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788197482.350790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197482.351042:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776282112:0@lo:400:kworker.0 00000100:00100000:0.0:1788197482.351076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197482.351109:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776282624:0@lo:400:kworker.0 00000100:00100000:0.0:1788197482.351129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197482.351161:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776282624 00000100:00100000:0.0:1788197482.351175:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776282624 00000100:00100000:0.0:1788197482.351206:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788197482.351213:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776282624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197482.351246:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776282624:12345-0@lo:400:kworker.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197482.351252:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788197482.351270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197482.351287:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776282624:0@lo:400:kworker.0 00010000:00080000:2.0:1788197482.351467:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2d80 x1875060776282496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197482.351479:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776282496:0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.356973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776282112 00000100:00100000:1.0:1788197482.356986:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776282112 00000100:00100000:1.0:1788197482.357060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788197482.357071:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776282112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.357163:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776282112:12345-0@lo:400:kworker.0 Request processed in 94us (6085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197482.357181:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788197482.357554:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776282240:0@lo:400:kworker.0 00000100:00100000:2.0:1788197482.357567:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776282752:0@lo:400:kworker.0 00000100:00100000:2.0:1788197482.357602:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197482.358187:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776282112:0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.360718:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776282752 00000100:00100000:1.0:1788197482.360731:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776282752 00000100:00100000:1.0:1788197482.360796:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788197482.360806:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776282752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197482.360908:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776282752:12345-0@lo:400:kworker.0 Request processed in 103us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197482.360915:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788197482.360957:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788197482.360960:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e1c00 x1875060776282752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197482.360973:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776282752:0@lo:400:kworker.0 00000100:00100000:0.0:1788197482.864250:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788197482.864271:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776282880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197482.864333:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197482.864413:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776282880 00000100:00100000:0.0:1788197482.864420:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776282880 00000100:00100000:0.0:1788197482.864463:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788197482.864471:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776282880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197482.864500:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197482.864540:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776282880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197482.864561:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788197482.864603:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c741798a80 x1875060776282880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197482.864622:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776282880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788197483.117976:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197483.375136:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776283008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197483.375209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197483.377881:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283008 00000100:00100000:3.0:1788197483.377892:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283008 00000100:00100000:3.0:1788197483.377937:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788197483.377946:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776283008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197483.377978:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197483.378039:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776283008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (2829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197483.378045:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788197483.386453:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c741798a80 x1875060776283008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197483.386477:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776283008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197484.142052:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197484.143450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197484.143492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197484.143560:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276672 00000100:00100000:1.0:1788197484.143564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276544 00000100:00100000:2.0:1788197484.143569:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276672 00000100:00100000:1.0:1788197484.143569:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276544 00000100:00100000:1.0:1788197484.143618:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:2.0:1788197484.143627:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:1.0:1788197484.143627:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2360:x1875060755276544:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197484.143633:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755276672:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197484.143697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:2360:x1875060755276544:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197484.143705:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:2.0:1788197484.143966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755276672:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 332us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197484.143973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00080000:3.0:1788197484.144093:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788197485.169545:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197486.193556:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197487.218716:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197487.472032:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776283392:0@lo:400:kworker.0 00000100:00100000:2.0:1788197487.472109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197487.472180:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197487.472196:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776283520:0@lo:400:kworker.0 00000100:00100000:2.0:1788197487.472223:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197487.472454:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283392 00000100:00100000:2.0:1788197487.472461:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283392 00000100:00100000:2.0:1788197487.472516:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788197487.472526:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776283392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197487.472576:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776283392:12345-0@lo:400:kworker.0 Request processed in 52us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197487.472583:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788197487.472622:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776283392:0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.472704:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776283136:0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.472744:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197487.472779:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776283648:0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.472803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197487.472857:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788197487.472865:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776283264:0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.472889:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197487.472907:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776283776:0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.472944:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788197487.472974:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197487.472994:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283648 00000100:00100000:3.0:1788197487.472998:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283648 00000100:00100000:3.0:1788197487.473028:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283264 00000100:00100000:3.0:1788197487.473031:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283264 00000100:00100000:3.0:1788197487.473050:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788197487.473058:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776283648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.473094:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776283648:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197487.473101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788197487.473117:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788197487.473123:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776283264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.473163:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776283264:12345-0@lo:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197487.473169:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788197487.473389:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197487.473414:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776283264:0@lo:400:kworker.0 00000100:00100000:3.0:1788197487.473424:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776283648:0@lo:400:kworker.0 00000100:00100000:1.0:1788197487.473533:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283520 00000100:00100000:1.0:1788197487.473538:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283520 00000100:00100000:1.0:1788197487.473570:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283776 00000100:00100000:1.0:1788197487.473573:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283776 00000100:00100000:1.0:1788197487.473601:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788197487.473608:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776283520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197487.473652:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776283520:12345-0@lo:400:kworker.0 Request processed in 45us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197487.473658:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788197487.473670:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788197487.473677:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776283776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197487.473709:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776283776:12345-0@lo:400:kworker.0 Request processed in 34us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197487.473716:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788197487.473741:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788197487.473744:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788197487.473763:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2680 x1875060776283520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197487.473774:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776283520:0@lo:400:kworker.0 00010000:00080000:1.0:1788197487.473795:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736f4bb80 x1875060776283776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197487.473803:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776283776:0@lo:400:kworker.0 00000100:00100000:2.0:1788197487.474372:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283136 00000100:00100000:2.0:1788197487.474379:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283136 00000100:00100000:2.0:1788197487.474417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788197487.474425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776283136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197487.474469:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776283136:12345-0@lo:400:kworker.0 Request processed in 45us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197487.474476:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788197487.474546:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776283136:0@lo:400:kworker.0 00000100:00100000:1.0:1788197487.983153:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776283904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197487.983220:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197487.983477:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776283904 00000100:00100000:3.0:1788197487.983485:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776283904 00000100:00100000:3.0:1788197487.983543:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788197487.983553:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776283904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197487.984784:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197487.984886:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776283904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1333us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197487.984895:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788197487.985122:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c741798a80 x1875060776283904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197487.985155:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776283904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788197488.238559:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197488.494612:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74179bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776284032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197488.494694:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197488.494813:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284032 00000100:00100000:0.0:1788197488.494844:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284032 00000100:00100000:0.0:1788197488.495243:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788197488.495255:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776284032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197488.495287:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197488.495336:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776284032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197488.495344:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788197488.495995:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c74179bb80 x1875060776284032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197488.496094:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74179bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776284032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788197489.262264:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197489.264583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197489.264681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197489.264917:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276928 00000100:00100000:2.0:1788197489.264926:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276928 00000100:00100000:3.0:1788197489.264975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755276800 00000100:00100000:3.0:1788197489.264981:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755276800 00000100:00100000:2.0:1788197489.265014:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:3.0:1788197489.265023:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 208 00000100:00100000:2.0:1788197489.265029:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755276928:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197489.265037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:2360:x1875060755276800:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197489.265116:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+10:2360:x1875060755276800:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 82us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197489.265124:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 208 00000100:00080000:1.0:1788197489.265478:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197489.266150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755276928:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 1123us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197489.266176:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00000001:02000400:2.0:1788197489.960343:0:10138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:31:28 (1788197488) === 00010000:00010000:3.0:1788197490.286143:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197490.518980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197490.519095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277056 00000100:00100000:2.0:1788197490.519105:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277056 00000100:00100000:2.0:1788197490.519172:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 209 00000100:00100000:2.0:1788197490.519182:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+10:8136:x1875060755277056:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788197490.519199:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197490.519216:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155c000/0x167e6c292403008c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5689 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197490.519244:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155c000/0x167e6c292403008c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5689 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197490.519253:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155c000/0x167e6c292403008c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5689 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197490.519262:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c000, rc 0) 00000100:00100000:2.0:1788197490.519339:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+11:8136:x1875060755277056:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 158us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197490.519346:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 209 00000100:00100000:1.0:1788197490.523860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197490.525778:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277184 00000100:00100000:3.0:1788197490.525796:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277184 00000100:00100000:3.0:1788197490.525899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:3.0:1788197490.525920:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+11:8136:x1875060755277184:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788197490.526309:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+11:8136:x1875060755277184:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 390us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197490.528933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:3.0:1788197490.540264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197490.544926:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277312 00000100:00100000:0.0:1788197490.544945:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277312 00000100:00100000:0.0:1788197490.545027:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:0.0:1788197490.545037:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+11:8136:x1875060755277312:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788197490.545303:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+11:8136:x1875060755277312:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 267us (5048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197490.545312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:0.0:1788197490.554433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197490.555098:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277440 00000100:00100000:3.0:1788197490.555108:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277440 00000100:00100000:3.0:1788197490.555180:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:3.0:1788197490.555190:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+11:8140:x1875060755277440:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788197490.556280:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+11:8140:x1875060755277440:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 1080us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197490.556295:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:1.0:1788197490.595057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197490.595160:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277568 00000100:00100000:2.0:1788197490.595169:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277568 00000100:00100000:2.0:1788197490.595225:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:2.0:1788197490.595235:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+11:8140:x1875060755277568:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788197490.596094:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+11:8140:x1875060755277568:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 857us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197490.596119:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:1.0:1788197490.635630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197490.635760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277696 00000100:00100000:0.0:1788197490.635770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277696 00000100:00100000:0.0:1788197490.635816:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 214 00000100:00100000:0.0:1788197490.635859:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+11:8136:x1875060755277696:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788197490.635872:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197490.635888:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700031000/0x167e6c2924030093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d56b3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197490.636582:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700031000/0x167e6c2924030093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56b3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197490.636596:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700031000/0x167e6c2924030093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56b3 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197490.636606:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031000, rc 0) 00000100:00100000:0.0:1788197490.636661:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+12:8136:x1875060755277696:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 804us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197490.636669:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 214 00000100:00100000:0.0:1788197490.653951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197490.656091:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277824 00000100:00100000:2.0:1788197490.656107:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277824 00000100:00100000:2.0:1788197490.656206:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:2.0:1788197490.656216:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+12:8136:x1875060755277824:12345-192.168.206.40@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788197490.656240:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788197490.656263:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788197490.656267:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788197490.656270:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788197490.656272:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788197490.659443:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+12:8136:x1875060755277824:12345-192.168.206.40@tcp:256:mount.lustre.0 Request processed in 3218us (5490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197490.659457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:1.0:1788197490.663366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197490.663678:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755277952 00000100:00100000:3.0:1788197490.663689:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755277952 00000100:00100000:3.0:1788197490.663758:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:3.0:1788197490.663768:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+12:8136:x1875060755277952:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788197490.663784:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197490.663800:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d56ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197490.663861:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197490.663873:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197490.663882:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6e00, rc 0) 00000100:00100000:0.0:1788197490.674857:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:8136:x1875060755277952:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 11078us (11486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197490.674889:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:0.0:1788197490.689608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197490.691307:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278080 00000100:00100000:2.0:1788197490.691321:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278080 00000100:00100000:2.0:1788197490.691400:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:2.0:1788197490.691411:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:8136:x1875060755278080:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788197490.691715:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:8136:x1875060755278080:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 298us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197490.691724:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:1.0:1788197490.697037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197490.702530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278208 00000100:00100000:0.0:1788197490.702544:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278208 00000100:00100000:0.0:1788197490.702685:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:0.0:1788197490.702696:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:8136:x1875060755278208:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788197490.702965:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:8136:x1875060755278208:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 269us (5938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197490.702973:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:1.0:1788197490.710243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197490.710532:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278336 00000100:00100000:3.0:1788197490.710544:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278336 00000100:00100000:3.0:1788197490.710604:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:3.0:1788197490.710614:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:8145:x1875060755278336:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788197490.710874:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:8145:x1875060755278336:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 260us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197490.710883:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:3.0:1788197490.719955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197490.720142:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278464 00000100:00100000:0.0:1788197490.720153:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278464 00000100:00100000:0.0:1788197490.720222:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:0.0:1788197490.720232:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:8145:x1875060755278464:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197490.721574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:8145:x1875060755278464:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 1053us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197490.721586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:1.0:1788197490.728129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197490.728238:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278592 00000100:00100000:3.0:1788197490.728247:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278592 00000100:00100000:3.0:1788197490.728292:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:3.0:1788197490.728300:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2356:x1875060755278592:12345-192.168.206.40@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788197490.728336:0:5871:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1778ea05-94ad-4fee-ac82-ea9fc3819e66@192.168.206.40@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1788197490.728369:0:5871:0:(genops.c:1385:class_connect()) connect: client 1778ea05-94ad-4fee-ac82-ea9fc3819e66, cookie 0x167e6c29240300a1 00000004:00100000:3.0:1788197490.728398:0:5871:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788197490.728641:0:5871:0:(import.c:65:import_set_state_nolock()) ffff93c7049bd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197490.728714:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2356:x1875060755278592:12345-192.168.206.40@tcp:38:mount.lustre.0 Request processed in 412us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197490.728721:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1788197490.740713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197490.741176:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278976 00000100:00100000:0.0:1788197490.741188:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278976 00000100:00100000:0.0:1788197490.741256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:0.0:1788197490.741266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755278976:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197490.741436:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755278976:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 171us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197490.741444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:1.0:1788197490.752656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197490.752755:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278848 00000100:00100000:3.0:1788197490.752766:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278848 00000100:00100000:1.0:1788197490.752803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197490.752851:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755278720 00000100:00100000:1.0:1788197490.752856:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755278720 00000100:00100000:1.0:1788197490.752889:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:1.0:1788197490.752902:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+7:8136:x1875060755278848:12345-192.168.206.40@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788197490.752903:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1788197490.752914:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+7:0:x1875060755278720:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788197490.752946:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000004:00000024:3.0:1788197490.752952:0:5871:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1788197490.752978:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197490.753048:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+7:8136:x1875060755278848:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 150us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197490.753056:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:2.0:1788197490.753080:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:0:x1875060755278720:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 165us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197490.753089:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1788197490.757171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197490.758645:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755279104 00000100:00100000:0.0:1788197490.758674:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755279104 00000100:00100000:0.0:1788197490.758739:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:0.0:1788197490.758749:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:8136:x1875060755279104:12345-192.168.206.40@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788197490.758863:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:8136:x1875060755279104:12345-192.168.206.40@tcp:40:mount.lustre.0 Request processed in 115us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197490.758870:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1788197490.763625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197490.763687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197490.763729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197490.763803:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755279488 00000100:00100000:3.0:1788197490.763812:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755279488 00000100:00100000:3.0:1788197490.763913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:3.0:1788197490.763924:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:8136:x1875060755279488:12345-192.168.206.40@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788197490.764001:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788197490.764081:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:8136:x1875060755279488:12345-192.168.206.40@tcp:33:mount.lustre.0 Request processed in 158us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197490.764089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:1.0:1788197490.765133:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755279232 00000100:00100000:1.0:1788197490.765144:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755279232 00000100:00100000:1.0:1788197490.765177:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755279360 00000100:00100000:1.0:1788197490.765181:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755279360 00000100:00100000:1.0:1788197490.765216:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1788197490.765223:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875060755279232:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788197490.765265:0:8021:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1778ea05-94ad-4fee-ac82-ea9fc3819e66@192.168.206.40@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:1.0:1788197490.765297:0:8021:0:(genops.c:1385:class_connect()) connect: client 1778ea05-94ad-4fee-ac82-ea9fc3819e66, cookie 0x167e6c29240300a8 00002000:00100000:1.0:1788197490.765307:0:8021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1778ea05-94ad-4fee-ac82-ea9fc3819e66/ffff93c741723000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788197490.765501:0:8021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788197490.765736:0:8021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788197490.765768:0:8021:0:(import.c:65:import_set_state_nolock()) ffff93c741722000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197490.765869:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2356:x1875060755279232:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 643us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197490.766247:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:3.0:1788197490.766254:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875060755279360:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788197490.766275:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1778ea05-94ad-4fee-ac82-ea9fc3819e66@192.168.206.40@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1788197490.766296:0:6696:0:(genops.c:1385:class_connect()) connect: client 1778ea05-94ad-4fee-ac82-ea9fc3819e66, cookie 0x167e6c29240300af 00002000:00100000:3.0:1788197490.766304:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1778ea05-94ad-4fee-ac82-ea9fc3819e66/ffff93c7049bf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788197490.766321:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788197490.766674:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788197490.766695:0:6696:0:(import.c:65:import_set_state_nolock()) ffff93c7049bb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197490.766727:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2356:x1875060755279360:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 473us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197490.766735:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1788197490.768303:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00010000:00010000:0.0:1788197491.310045:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197492.334936:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197492.595130:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776284160:0@lo:400:kworker.0 00000100:00100000:1.0:1788197492.595196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197492.595267:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284160 00000100:00100000:1.0:1788197492.595274:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284160 00000100:00100000:2.0:1788197492.595300:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776284288:0@lo:400:kworker.0 00000100:00100000:1.0:1788197492.595315:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788197492.595330:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197492.595350:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776284800:0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197492.595391:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788197492.595396:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776284672:0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595415:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197492.595439:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776284416:0@lo:400:kworker.0 00000100:00100000:1.0:1788197492.595459:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776284160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595460:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197492.595476:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197492.595481:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776284544:0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595499:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197492.595503:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776284160:12345-0@lo:400:kworker.0 Request processed in 47us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197492.595511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788197492.595522:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284288 00000100:00100000:2.0:1788197492.595526:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284288 00000100:00100000:2.0:1788197492.595547:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284672 00000100:00100000:2.0:1788197492.595550:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284672 00000100:00100000:1.0:1788197492.595553:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776284160:0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284416 00000100:00100000:2.0:1788197492.595570:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284416 00000100:00100000:2.0:1788197492.595585:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788197492.595591:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776284288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595640:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776284288:12345-0@lo:400:kworker.0 Request processed in 49us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197492.595646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788197492.595659:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788197492.595674:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776284672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595701:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776284672:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197492.595707:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788197492.595720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788197492.595726:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776284416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197492.595736:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776284672:0@lo:400:kworker.0 00000100:00100000:1.0:1788197492.595746:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776284288:0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595753:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776284416:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197492.595759:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788197492.595775:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284800 00000100:00100000:2.0:1788197492.595778:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284800 00000100:00100000:2.0:1788197492.595809:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284544 00000100:00100000:2.0:1788197492.595812:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284544 00000100:00100000:2.0:1788197492.595849:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788197492.595855:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788197492.595856:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776284800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197492.595861:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776284544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197492.595891:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776284800:12345-0@lo:400:kworker.0 Request processed in 36us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197492.595907:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788197492.595933:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197492.595937:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197492.595940:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788197492.595956:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736f49500 x1875060776284544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197492.595959:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776284544:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197492.595967:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776284544:0@lo:400:kworker.0 00000100:00100000:1.0:1788197492.595967:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788197492.595975:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776284416:0@lo:400:kworker.0 00010000:00080000:2.0:1788197492.595999:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736f4a300 x1875060776284800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197492.596015:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776284800:0@lo:400:kworker.0 00000100:00100000:1.0:1788197493.103530:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776284928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197493.103607:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197493.103657:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776284928 00000100:00100000:0.0:1788197493.103666:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776284928 00000100:00100000:0.0:1788197493.103731:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788197493.103740:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776284928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197493.103775:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197493.103857:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776284928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197493.103864:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788197493.103987:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c741798700 x1875060776284928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197493.104008:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776284928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197493.360114:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197493.617129:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197493.617163:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776285056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197493.617230:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197493.617527:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285056 00000100:00100000:0.0:1788197493.617535:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285056 00000100:00100000:0.0:1788197493.617580:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788197493.617588:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776285056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197493.617628:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197493.617680:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776285056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197493.617688:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788197493.618053:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736f4a300 x1875060776285056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197493.618071:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776285056:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788197493.684168:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000001:00100000:2.0:1788197493.687159:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000001:00100000:2.0:1788197493.694503:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1778ea05-94ad-4fee-ac82-ea9fc3819e66 00010000:00010000:3.0:1788197494.382472:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197495.407114:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197495.927706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197495.927757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197495.927792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197495.927803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755279616 00000100:00100000:1.0:1788197495.927815:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755279616 00000100:00100000:2.0:1788197495.927858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197495.927903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197495.927927:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755279872 00000100:00100000:2.0:1788197495.927931:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755279872 00000100:00100000:2.0:1788197495.927977:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755279744 00000100:00100000:2.0:1788197495.927980:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755279744 00000100:00100000:2.0:1788197495.928002:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:2.0:1788197495.928012:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755279872:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197495.928051:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 222 00000100:00100000:1.0:1788197495.928063:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755279616:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197495.928080:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755279872:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 68us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197495.928088:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:1.0:1788197495.928112:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755279616:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 51us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197495.928119:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:1.0:1788197495.928124:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 222 00000100:00100000:2.0:1788197495.928131:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755279744:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197495.928164:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755279744:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 36us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197495.928173:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00080000:1.0:1788197495.928174:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197495.928190:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280128 00000100:00100000:1.0:1788197495.928195:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280128 00000100:00080000:2.0:1788197495.928226:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197495.928231:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280000 00000100:00100000:1.0:1788197495.928236:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280000 00000100:00100000:2.0:1788197495.928254:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1788197495.928327:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755280128:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197495.928355:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755280128:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00080000:3.0:1788197495.928527:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197495.937659:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:3.0:1788197495.937687:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755280000:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197495.937772:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755280000:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 100us (9868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197495.937779:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:2.0:1788197495.942637:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00010000:00010000:1.0:1788197496.432379:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788197496.871062:0:10334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788197497.454140:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197497.710227:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776285440:0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.710320:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197497.710393:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197497.710400:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776285568:0@lo:400:kworker.0 00000100:00100000:2.0:1788197497.710432:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776285312:0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.710432:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197497.710472:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197497.710502:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285440 00000100:00100000:2.0:1788197497.710506:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776285824:0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.710510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285440 00000100:00100000:2.0:1788197497.710534:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197497.710573:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285312 00000100:00100000:0.0:1788197497.710577:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285312 00000100:00100000:0.0:1788197497.710595:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788197497.710603:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776285440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197497.710710:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788197497.710720:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776285312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197497.710870:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776285184:0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.713168:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776285440:12345-0@lo:400:kworker.0 Request processed in 2555us (2838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197497.713182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788197497.713303:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776285440:0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.713439:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285568 00000100:00100000:0.0:1788197497.713447:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285568 00000100:00100000:0.0:1788197497.713491:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285824 00000100:00100000:0.0:1788197497.713494:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285824 00000100:00100000:0.0:1788197497.713519:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788197497.713527:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776285568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.714278:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776285568:12345-0@lo:400:kworker.0 Request processed in 750us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197497.714286:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788197497.715129:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788197497.715148:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776285824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.715203:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776285824:12345-0@lo:400:kworker.0 Request processed in 64us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197497.715209:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788197497.716890:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c706b3fb80 x1875060776285568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197497.716907:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776285568:0@lo:400:kworker.0 00000100:00080000:0.0:1788197497.716959:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197497.716964:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197497.716968:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788197497.717605:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c281500 x1875060776285824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197497.717620:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776285824:0@lo:400:kworker.0 00000100:00100000:3.0:1788197497.721856:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776285312:12345-0@lo:400:kworker.0 Request processed in 11095us (11341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197497.721871:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788197497.722703:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197497.722764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776285696:0@lo:400:kworker.0 00000100:00100000:0.0:1788197497.722806:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197497.723074:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285184 00000100:00100000:1.0:1788197497.723095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285184 00000100:00100000:1.0:1788197497.723145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788197497.723154:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776285184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197497.723208:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776285184:12345-0@lo:400:kworker.0 Request processed in 55us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197497.723215:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788197497.723295:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776285184:0@lo:400:kworker.0 00000100:00100000:3.0:1788197497.725587:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285696 00000100:00100000:3.0:1788197497.725602:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285696 00000100:00100000:3.0:1788197497.725698:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788197497.725709:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776285696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197497.725806:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776285696:12345-0@lo:400:kworker.0 Request processed in 98us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197497.725812:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788197497.725877:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776285696:0@lo:400:kworker.0 00000100:00080000:0.0:1788197497.727657:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197497.728730:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776285312:0@lo:400:kworker.0 00000100:00100000:1.0:1788197498.222121:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74179bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776285952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197498.222190:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197498.222294:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776285952 00000100:00100000:0.0:1788197498.222303:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776285952 00000100:00100000:0.0:1788197498.222357:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788197498.222378:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776285952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197498.222410:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197498.222454:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776285952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197498.222461:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788197498.222608:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c74179bb80 x1875060776285952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197498.222629:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74179bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776285952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788197498.478324:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197498.738315:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776286080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197498.738401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197498.738504:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286080 00000100:00100000:2.0:1788197498.738512:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286080 00000100:00100000:2.0:1788197498.738556:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788197498.738566:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776286080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788197498.738599:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197498.738644:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776286080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197498.738651:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788197498.739330:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736f49180 x1875060776286080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197498.739840:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776286080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197499.502034:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197500.527441:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197501.040379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197501.040421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197501.040453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197501.040475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197501.040505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197501.040533:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280640 00000100:00100000:2.0:1788197501.040542:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280640 00000100:00100000:2.0:1788197501.040596:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280768 00000100:00100000:2.0:1788197501.040599:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280768 00000100:00100000:2.0:1788197501.040620:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:2.0:1788197501.040629:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755280640:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197501.040692:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755280640:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 63us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197501.040698:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:2.0:1788197501.040714:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:2.0:1788197501.040720:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755280768:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197501.040746:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755280768:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197501.040752:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:2.0:1788197501.040768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280256 00000100:00100000:2.0:1788197501.040771:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280256 00000100:00100000:2.0:1788197501.040793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00100000:2.0:1788197501.040799:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755280256:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197501.040892:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755280256:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 92us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197501.040899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00080000:2.0:1788197501.041052:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197501.041056:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197501.041136:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280384 00000100:00100000:3.0:1788197501.041141:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280384 00000100:00100000:3.0:1788197501.041182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280512 00000100:00100000:3.0:1788197501.041186:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280512 00000100:00100000:3.0:1788197501.041207:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:3.0:1788197501.041215:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755280384:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197501.041247:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755280384:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 33us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197501.041254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:3.0:1788197501.041268:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:3.0:1788197501.041274:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755280512:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197501.041297:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755280512:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 24us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197501.041311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00080000:2.0:1788197501.041593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788197501.550117:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197502.575275:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197502.830684:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776286208:0@lo:400:kworker.0 00000100:00100000:1.0:1788197502.830753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197502.830849:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776286720:0@lo:400:kworker.0 00000100:00100000:1.0:1788197502.830875:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197502.830897:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788197502.830902:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776286336:0@lo:400:kworker.0 00000100:00100000:1.0:1788197502.830943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197502.830963:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776286848:0@lo:400:kworker.0 00000100:00100000:1.0:1788197502.830988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197502.831024:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286720 00000100:00100000:1.0:1788197502.831031:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286720 00000100:00100000:1.0:1788197502.831090:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286336 00000100:00100000:1.0:1788197502.831093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286336 00000100:00100000:1.0:1788197502.831115:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788197502.831123:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776286720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197502.831172:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776286720:12345-0@lo:400:kworker.0 Request processed in 49us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197502.831358:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776286464:0@lo:400:kworker.0 00000100:00100000:0.0:1788197502.831389:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197502.831418:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197502.831424:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776286592:0@lo:400:kworker.0 00000100:00100000:0.0:1788197502.831464:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197502.831505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286464 00000100:00100000:0.0:1788197502.831509:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286464 00000100:00100000:0.0:1788197502.831533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788197502.831551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776286336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197502.831586:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776286336:12345-0@lo:400:kworker.0 Request processed in 47us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197502.831593:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788197502.831608:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788197502.831614:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776286464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197502.831643:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776286464:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197502.831649:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788197502.831684:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776286464:0@lo:400:kworker.0 00000100:00100000:0.0:1788197502.831724:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776286336:0@lo:400:kworker.0 00000100:00100000:0.0:1788197502.831734:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776286720:0@lo:400:kworker.0 00000100:00100000:2.0:1788197502.832052:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286848 00000100:00100000:2.0:1788197502.832068:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286848 00000100:00100000:2.0:1788197502.832109:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286592 00000100:00100000:2.0:1788197502.832112:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286592 00000100:00100000:2.0:1788197502.832135:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788197502.832142:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776286848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197502.832203:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776286848:12345-0@lo:400:kworker.0 Request processed in 61us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197502.832210:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788197502.832221:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788197502.832227:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776286592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197502.832260:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776286592:12345-0@lo:400:kworker.0 Request processed in 33us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197502.832266:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788197502.832280:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197502.832284:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197502.832286:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788197502.832314:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c282680 x1875060776286592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197502.832324:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776286592:0@lo:400:kworker.0 00010000:00080000:2.0:1788197502.832347:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c280000 x1875060776286848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197502.832366:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776286848:0@lo:400:kworker.0 00000100:00100000:1.0:1788197502.832641:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788197502.832951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286208 00000100:00100000:3.0:1788197502.832958:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286208 00000100:00100000:3.0:1788197502.832997:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788197502.833004:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776286208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197502.833074:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776286208:12345-0@lo:400:kworker.0 Request processed in 70us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197502.833080:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788197502.833343:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776286208:0@lo:400:kworker.0 00000100:00100000:0.0:1788197503.344077:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788197503.344097:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74179b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776286976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197503.344161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197503.344244:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776286976 00000100:00100000:0.0:1788197503.344251:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776286976 00000100:00100000:0.0:1788197503.344292:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788197503.344302:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776286976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197503.344332:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197503.344373:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776286976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197503.344379:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788197503.344417:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c74179b480 x1875060776286976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197503.344435:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74179b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776286976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197503.598757:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197503.854506:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197503.854525:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776287104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197503.854584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197503.854614:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776287104 00000100:00100000:0.0:1788197503.854623:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776287104 00000100:00100000:0.0:1788197503.854684:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788197503.854695:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776287104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197503.854729:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788197503.854802:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c283b80 x1875060776287104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197503.854845:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776287104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197503.856431:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776287104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1732us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197503.856441:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788197504.623588:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197505.654941:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197506.164227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197506.164276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197506.164319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197506.164344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197506.164369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197506.164396:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281408 00000100:00100000:3.0:1788197506.164404:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281408 00000100:00100000:3.0:1788197506.164456:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281280 00000100:00100000:3.0:1788197506.164460:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281280 00000100:00100000:3.0:1788197506.164500:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:3.0:1788197506.164509:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755281408:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197506.164573:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755281408:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 65us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197506.164581:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:3.0:1788197506.164599:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:3.0:1788197506.164605:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755281280:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197506.164631:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755281280:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197506.164638:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00080000:3.0:1788197506.164656:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788197506.164659:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788197506.164810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281152 00000100:00100000:0.0:1788197506.164815:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281152 00000100:00100000:0.0:1788197506.164882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281024 00000100:00100000:0.0:1788197506.164886:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281024 00000100:00100000:0.0:1788197506.164907:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:0.0:1788197506.164913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755281152:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197506.164948:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755281152:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197506.164961:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:0.0:1788197506.164975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:0.0:1788197506.164982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755281024:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197506.165008:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755281024:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197506.165014:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00080000:3.0:1788197506.165461:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197506.165609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755280896 00000100:00100000:1.0:1788197506.165614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755280896 00000100:00100000:1.0:1788197506.165652:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 226 00000100:00100000:1.0:1788197506.165660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755280896:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197506.165696:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755280896:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 37us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197506.165702:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 226 00010000:00010000:0.0:1788197506.669971:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197507.694018:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197507.950047:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776287488:0@lo:400:kworker.0 00000100:00100000:3.0:1788197507.950117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197507.950302:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788197507.950331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197507.950372:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776287488 00000100:00100000:0.0:1788197507.950378:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776287488 00000100:00100000:0.0:1788197507.950425:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776287360 00000100:00100000:0.0:1788197507.950428:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776287360 00000100:00100000:0.0:1788197507.950449:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788197507.950457:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776287488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197507.950500:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776287488:12345-0@lo:400:kworker.0 Request processed in 44us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197507.950508:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788197507.950523:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788197507.950528:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776287360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197507.950571:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776287360:12345-0@lo:400:kworker.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197507.950577:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788197507.950716:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776287232:0@lo:400:kworker.0 00000100:00100000:2.0:1788197507.950749:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197507.950955:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776287488:0@lo:400:kworker.0 00000100:00100000:3.0:1788197507.950971:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197507.950976:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776287616:0@lo:400:kworker.0 00000100:00100000:3.0:1788197507.950999:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788197507.951040:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197507.951050:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776287616 00000100:00100000:3.0:1788197507.951054:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776287616 00000100:00100000:3.0:1788197507.951082:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788197507.951088:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776287616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197507.951189:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776287360:0@lo:400:kworker.0 00000100:00100000:2.0:1788197507.951196:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776287872:0@lo:400:kworker.0 00000100:00100000:2.0:1788197507.951219:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197507.951265:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776287744:0@lo:400:kworker.0 00000100:00100000:2.0:1788197507.951287:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197507.951317:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776287744 00000100:00100000:2.0:1788197507.951321:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776287744 00000100:00100000:2.0:1788197507.951346:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788197507.951364:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776287744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197507.951398:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776287744:12345-0@lo:400:kworker.0 Request processed in 47us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197507.951403:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788197507.951441:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776287744:0@lo:400:kworker.0 00000100:00100000:3.0:1788197507.951775:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776287616:12345-0@lo:400:kworker.0 Request processed in 686us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197507.951789:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788197507.951802:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776287872 00000100:00100000:3.0:1788197507.951805:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776287872 00000100:00100000:3.0:1788197507.951859:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788197507.951866:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776287872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197507.951900:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776287872:12345-0@lo:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197507.951906:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788197507.951921:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788197507.951925:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788197507.951927:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788197507.951951:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480df80 x1875060776287872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197507.951961:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776287872:0@lo:400:kworker.0 00010000:00080000:3.0:1788197507.951983:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480ca80 x1875060776287616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197507.951992:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776287616:0@lo:400:kworker.0 00000100:00100000:0.0:1788197507.952136:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776287232 00000100:00100000:0.0:1788197507.952145:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776287232 00000100:00100000:0.0:1788197507.952188:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788197507.952195:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776287232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197507.952227:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776287232:12345-0@lo:400:kworker.0 Request processed in 33us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197507.952233:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788197507.952517:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776287232:0@lo:400:kworker.0 00000100:00100000:3.0:1788197508.463779:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776288000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197508.463885:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197508.464125:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288000 00000100:00100000:2.0:1788197508.464133:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288000 00000100:00100000:2.0:1788197508.464180:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788197508.464189:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776288000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788197508.464220:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197508.464264:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776288000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197508.464278:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788197508.464315:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736f48380 x1875060776288000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197508.464333:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776288000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197508.719062:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197508.978419:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776288128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197508.978486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197508.978594:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288128 00000100:00100000:1.0:1788197508.978601:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288128 00000100:00100000:1.0:1788197508.978642:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788197508.978650:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776288128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788197508.978679:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197508.978720:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776288128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197508.978727:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788197508.979664:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480df80 x1875060776288128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197508.979684:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776288128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788197509.743441:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197510.766366:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197511.280807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197511.280880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197511.280996:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281920 00000100:00100000:0.0:1788197511.281006:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281920 00000100:00100000:0.0:1788197511.281080:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282048 00000100:00100000:0.0:1788197511.281083:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282048 00000100:00100000:0.0:1788197511.281105:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:0.0:1788197511.281115:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2356:x1875060755281920:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:0.0:1788197511.281142:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c29240300a8 00000100:00080000:0.0:1788197511.281152:0:6699:0:(import.c:65:import_set_state_nolock()) ffff93c741722000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788197511.281186:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788197511.281501:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+2:2356:x1875060755281920:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 386us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197511.281509:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:0.0:1788197511.281525:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:0.0:1788197511.281532:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2356:x1875060755282048:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:0.0:1788197511.281542:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c29240300af 00000100:00080000:0.0:1788197511.281547:0:6699:0:(import.c:65:import_set_state_nolock()) ffff93c7049bb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788197511.281566:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788197511.281730:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+2:2356:x1875060755282048:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 198us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197511.281751:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00010000:00010000:0.0:1788197511.281891:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788197511.282634:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788197511.282640:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788197511.282648:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197511.284502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197511.284548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197511.284590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197511.284681:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281792 00000100:00100000:2.0:1788197511.284691:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281792 00000100:00100000:2.0:1788197511.284750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281664 00000100:00100000:2.0:1788197511.284753:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281664 00000100:00100000:2.0:1788197511.284778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:2.0:1788197511.284789:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755281792:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197511.284875:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755281792:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197511.284883:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:2.0:1788197511.284910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:2.0:1788197511.284917:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755281664:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197511.284942:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755281664:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197511.284948:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00080000:0.0:1788197511.285067:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197511.285253:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755281536 00000100:00100000:3.0:1788197511.285269:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755281536 00000100:00100000:3.0:1788197511.285305:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 228 00000100:00100000:3.0:1788197511.285312:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755281536:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197511.285339:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755281536:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197511.285345:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 228 00010000:00010000:0.0:1788197511.790351:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197512.818072:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197513.076611:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776288384:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.076680:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197513.076729:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776288896:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.076753:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197513.076800:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788197513.076806:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776288256:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.076874:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197513.076897:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776288768:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.076919:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197513.076961:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776288512:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.076983:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197513.077012:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197513.077018:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776288640:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.077038:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197513.077069:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288384 00000100:00100000:2.0:1788197513.077076:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288384 00000100:00100000:2.0:1788197513.077530:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288768 00000100:00100000:2.0:1788197513.077535:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288768 00000100:00100000:2.0:1788197513.077560:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288512 00000100:00100000:2.0:1788197513.077563:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288512 00000100:00100000:2.0:1788197513.077580:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788197513.077588:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776288384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.077640:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776288384:12345-0@lo:400:kworker.0 Request processed in 51us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197513.077647:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788197513.077664:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788197513.077671:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776288768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.077699:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776288768:12345-0@lo:400:kworker.0 Request processed in 29us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197513.077705:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788197513.077717:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788197513.077723:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776288512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.077768:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776288512:12345-0@lo:400:kworker.0 Request processed in 46us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197513.077774:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788197513.077881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288256 00000100:00100000:2.0:1788197513.077885:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288256 00000100:00100000:2.0:1788197513.077912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788197513.077920:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776288256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.078023:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776288256:12345-0@lo:400:kworker.0 Request processed in 104us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197513.078029:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788197513.078066:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288896 00000100:00100000:2.0:1788197513.078071:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288896 00000100:00100000:2.0:1788197513.078463:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776288640 00000100:00100000:2.0:1788197513.078468:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776288640 00000100:00100000:2.0:1788197513.078494:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788197513.078501:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776288896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.078536:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776288896:12345-0@lo:400:kworker.0 Request processed in 36us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197513.078542:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788197513.078553:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788197513.078559:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776288640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.078585:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776288640:12345-0@lo:400:kworker.0 Request processed in 26us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197513.078590:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788197513.078610:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197513.078613:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197513.078616:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788197513.078662:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c282a00 x1875060776288640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197513.078677:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776288640:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.078690:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776288512:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.078725:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776288256:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.078736:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776288768:0@lo:400:kworker.0 00000100:00100000:2.0:1788197513.078745:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776288384:0@lo:400:kworker.0 00010000:00080000:2.0:1788197513.078755:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e3100 x1875060776288896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197513.081623:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776288896:0@lo:400:kworker.0 00000100:00100000:3.0:1788197513.583154:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197513.583172:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776289024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197513.583241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197513.583556:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289024 00000100:00100000:3.0:1788197513.583563:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289024 00000100:00100000:3.0:1788197513.583605:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788197513.583614:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776289024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197513.583644:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197513.583684:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776289024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197513.583690:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788197513.583725:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480f480 x1875060776289024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197513.583742:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776289024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197513.838399:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197514.099211:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197514.099233:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776289152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197514.099298:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197514.099356:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289152 00000100:00100000:3.0:1788197514.099363:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289152 00000100:00100000:3.0:1788197514.099417:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788197514.099425:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776289152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197514.099455:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197514.099496:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776289152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197514.099502:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788197514.099539:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c70480f480 x1875060776289152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197514.099554:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776289152:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788197514.206234:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000020:00000080:2.0:1788197514.206243:0:6721:0:(genops.c:885:class_export_put()) final put ffff93c741723000/1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000020:00000080:3.0:1788197514.210374:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c741723000/1778ea05-94ad-4fee-ac82-ea9fc3819e66 for lustre-OST0000 00000020:00000080:3.0:1788197514.210433:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c741722000 for lustre-OST0000 00000001:00100000:2.0:1788197514.231028:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000020:00000080:2.0:1788197514.231036:0:7661:0:(genops.c:885:class_export_put()) final put ffff93c7049bf000/1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000020:00000080:1.0:1788197514.231111:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c7049bf000/1778ea05-94ad-4fee-ac82-ea9fc3819e66 for lustre-OST0001 00000020:00000080:1.0:1788197514.231160:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c7049bb800 for lustre-OST0001 00010000:00010000:0.0:1788197514.862097:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788197515.783590:0:11037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788197515.887006:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197516.413322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197516.413366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197516.413402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197516.413493:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282432 00000100:00100000:1.0:1788197516.413513:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282432 00000100:00100000:1.0:1788197516.413580:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282304 00000100:00100000:1.0:1788197516.413583:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282304 00000100:00100000:1.0:1788197516.413606:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:1.0:1788197516.413615:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755282432:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197516.413678:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755282432:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 64us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197516.413685:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:1.0:1788197516.413700:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:1.0:1788197516.413706:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755282304:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197516.413727:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755282304:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 22us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197516.413733:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00080000:0.0:1788197516.413995:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197516.414185:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282176 00000100:00100000:2.0:1788197516.414190:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282176 00000100:00100000:2.0:1788197516.414228:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 230 00000100:00100000:2.0:1788197516.414235:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755282176:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197516.414279:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755282176:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 44us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197516.414286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 230 00010000:00010000:3.0:1788197516.909992:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197517.934061:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197518.190166:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776289664:0@lo:400:kworker.0 00000100:00100000:1.0:1788197518.190251:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197518.190340:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776289408:0@lo:400:kworker.0 00000100:00100000:2.0:1788197518.190387:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197518.190442:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776289920:0@lo:400:kworker.0 00000100:00100000:2.0:1788197518.190474:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289408 00000100:00100000:2.0:1788197518.190481:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289408 00000100:00100000:2.0:1788197518.190531:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788197518.190539:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776289408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197518.190588:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776289408:12345-0@lo:400:kworker.0 Request processed in 50us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197518.190595:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788197518.190723:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776289280:0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.190757:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197518.190788:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776289792:0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.190810:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197518.190871:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776289536:0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.190893:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197518.190916:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289792 00000100:00100000:3.0:1788197518.190920:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289792 00000100:00100000:3.0:1788197518.190947:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289536 00000100:00100000:3.0:1788197518.190950:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289536 00000100:00100000:3.0:1788197518.190964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788197518.190982:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776289792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.191015:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776289792:12345-0@lo:400:kworker.0 Request processed in 45us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197518.191027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788197518.191041:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788197518.191046:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776289536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.191073:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776289536:12345-0@lo:400:kworker.0 Request processed in 27us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197518.191078:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788197518.191094:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197518.191117:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776289536:0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.191137:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776289792:0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.191363:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289664 00000100:00100000:3.0:1788197518.191368:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289664 00000100:00100000:3.0:1788197518.191403:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788197518.191409:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776289664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.191442:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776289664:12345-0@lo:400:kworker.0 Request processed in 33us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197518.191448:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788197518.191471:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c740ff8700 x1875060776289664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197518.191481:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776289664:0@lo:400:kworker.0 00000100:00080000:1.0:1788197518.191527:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788197518.191581:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289280 00000100:00100000:2.0:1788197518.191585:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289280 00000100:00100000:2.0:1788197518.191617:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788197518.191926:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776289280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197518.191963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776289280:12345-0@lo:400:kworker.0 Request processed in 340us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197518.191980:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788197518.192015:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197518.192046:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788197518.192110:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776289280:0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.192177:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776289920 00000100:00100000:3.0:1788197518.192181:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776289920 00000100:00100000:3.0:1788197518.192221:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788197518.192227:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776289920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197518.192337:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776289920:12345-0@lo:400:kworker.0 Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197518.192355:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788197518.192382:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c740ffb100 x1875060776289920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197518.192392:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776289920:0@lo:400:kworker.0 00000100:00080000:1.0:1788197518.192440:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788197518.702849:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197518.702922:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197518.703004:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776290048 00000100:00100000:2.0:1788197518.703010:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776290048 00000100:00100000:2.0:1788197518.703056:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788197518.703065:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776290048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788197518.703097:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197518.703138:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197518.703152:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788197518.703191:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2680 x1875060776290048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197518.703209:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776290048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788197518.960173:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788197519.211555:0:11184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff35ff7fb0 20000000:00000080:0.0:1788197519.211571:0:11184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c7414c0000 uarg=0000000000000000 20000000:01000000:0.0:1788197519.211604:0:11184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788197519.211609:0:11184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788197519.211613:0:11184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788197519.213162:0:11185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788197519.213317:0:11184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788197519.234278:0:11184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788197519.234866:0:11184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.234887:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.234896:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030062 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.234904:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.234912:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403007e expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.234919:0:11184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.234928:0:11184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235058:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235072:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 12 pid: 5836 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197519.235092:0:11184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736aca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290304:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197519.235179:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292403007e expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235188:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292403007e expref: 18 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197519.235197:0:11184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290432:0@lo:104: 00000100:00100000:3.0:1788197519.235235:0:11184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197519.235270:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776290432 00000100:00100000:3.0:1788197519.235276:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776290432 00000100:00100000:3.0:1788197519.235321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788197519.235331:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:11184:x1875060776290432:12345-0@lo:104: 00010000:00010000:3.0:1788197519.235343:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235386:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788197519.235392:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:11184:x1875060776290432:12345-0@lo:104: Request processed in 63us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197519.235400:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788197519.235423:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197519.235429:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235437:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031a00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197519.235441:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235461:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197519.235469:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197519.235476:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788197519.235505:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235511:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197519.235526:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235533:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700031a00/0x167e6c292403007e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030085 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235546:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197519.235548:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197519.235549:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197519.235561:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776290560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788197519.235593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788197519.235640:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235648:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197519.235657:0:11184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290688:0@lo:104: 00000100:00100000:3.0:1788197519.235685:0:11184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788197519.235709:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c2924030062 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235717:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c2924030062 expref: 18 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197519.235724:0:11184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290816:0@lo:104: 00000100:00100000:3.0:1788197519.235742:0:11184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197519.235760:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776290688 00000100:00100000:3.0:1788197519.235764:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776290688 00000100:00100000:3.0:1788197519.235782:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776290816 00000100:00100000:3.0:1788197519.235784:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776290816 00000100:00100000:3.0:1788197519.235797:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788197519.235802:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:11184:x1875060776290688:12345-0@lo:104: 00010000:00010000:3.0:1788197519.235809:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235862:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788197519.235867:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:11184:x1875060776290688:12345-0@lo:104: Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197519.235872:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788197519.235884:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788197519.235890:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:11184:x1875060776290816:12345-0@lo:104: 00010000:00010000:3.0:1788197519.235897:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235925:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788197519.235930:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+3:11184:x1875060776290816:12345-0@lo:104: Request processed in 41us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197519.235941:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788197519.235984:0:11184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.235993:0:11184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 12 pid: 5833 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197519.236002:0:11184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290944:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197519.236029:0:11184:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7186e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788197519.236046:0:11184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290432:0@lo:104: 00000100:00100000:3.0:1788197519.236054:0:11184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290688:0@lo:104: 00000100:00100000:3.0:1788197519.236060:0:11184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290816:0@lo:104: 00000100:00100000:3.0:1788197519.236089:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197519.236098:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197519.236126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197519.236180:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776290176 00000100:00100000:3.0:1788197519.236184:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776290176 00000100:00100000:3.0:1788197519.236210:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788197519.236216:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776290176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197519.236242:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197519.236279:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776290176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197519.236286:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788197519.236311:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736acb100 x1875060776290176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197519.236325:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197519.240382:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776290560 00000100:00100000:1.0:1788197519.240396:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776290560 00010000:00010000:1.0:1788197519.240436:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292403007e expref: 19 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197519.240471:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788197519.240493:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7066c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776290560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197519.240509:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197519.240515:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292403007e expref: 19 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.240526:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292403007e expref: 19 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.240543:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030800/0x167e6c2924030085 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292403007e expref: 19 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.240559:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197519.240631:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7066c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3313:x1875060776290560:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (5037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197519.240638:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788197519.241422:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776290560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788197519.242387:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788197519.242395:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242405:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:0.0:1788197519.242409:0:8526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242429:0:8526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788197519.242435:0:8526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197519.242440:0:8526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788197519.242485:0:8526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242491:0:8526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788197519.242509:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242516:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700031e00/0x167e6c2924030070 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030077 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242527:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197519.242530:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242536:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:0.0:1788197519.242539:0:8526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242545:0:8526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788197519.242551:0:8526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197519.242563:0:8526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788197519.242579:0:8526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242585:0:8526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788197519.242602:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242608:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c74155da00/0x167e6c2924030062 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924030069 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.242624:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197519.242626:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197519.242628:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197519.242636:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197519.242652:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776291072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788197519.242712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197519.243640:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291072 00000100:00100000:0.0:1788197519.243649:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291072 00010000:00010000:0.0:1788197519.243678:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197519.243707:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788197519.243716:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3314:x1875060776291072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788197519.243727:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197519.243733:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.244095:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.244112:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700031800/0x167e6c2924030077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c2924030070 expref: 18 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197519.244125:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197519.245691:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3314:x1875060776291072:12345-0@lo:103:ldlm_bl.0 Request processed in 1103us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197519.245706:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788197519.246226:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776291072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788197519.246388:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788197519.246405:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776291200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788197519.246456:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197519.246856:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291200 00000100:00100000:3.0:1788197519.246864:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291200 00010000:00010000:3.0:1788197519.246895:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924030062 expref: 17 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197519.246926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788197519.246946:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3312:x1875060776291200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788197519.246960:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197519.246974:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924030062 expref: 17 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.246986:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c2924030062 expref: 17 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.247002:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030c00/0x167e6c2924030069 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c2924030062 expref: 17 pid: 5836 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.247016:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197519.247063:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3312:x1875060776291200:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197519.247071:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788197519.248747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197519.248780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197519.249074:0:11184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736aca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290304:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197519.249087:0:11184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11184:1875060776290944:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197519.249117:0:11184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197519.250177:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282560 00000100:00100000:1.0:1788197519.250188:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282560 00010000:00010000:1.0:1788197519.250229:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 13 pid: 5836 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197519.250267:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282688 00000100:00100000:1.0:1788197519.250270:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282688 00010000:00010000:1.0:1788197519.250284:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 14 pid: 5833 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197519.250309:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:1.0:1788197519.250318:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05358cfc-7070-4d77-b166-215daa591621+14:2360:x1875060755282560:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197519.250331:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197519.250336:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 14 pid: 5836 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250362:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 14 pid: 5836 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250381:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6e00/0x167e6c292403009a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56ba expref: 14 pid: 5836 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250397:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197519.250451:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755282560:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 133us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197519.250458:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:1.0:1788197519.250477:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:1.0:1788197519.250483:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05358cfc-7070-4d77-b166-215daa591621+12:2360:x1875060755282688:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197519.250491:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197519.250495:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 12 pid: 5833 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250504:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 12 pid: 5833 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250514:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700031600/0x167e6c292403005b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5682 expref: 12 pid: 5833 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250526:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250534:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250560:0:8468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250567:0:8468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250572:0:8468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250579:0:8468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250585:0:8468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197519.250589:0:8468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250598:0:8468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250609:0:8468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197519.250619:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197519.250640:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05358cfc-7070-4d77-b166-215daa591621+11:2360:x1875060755282688:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 157us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197519.250647:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:1.0:1788197519.250798:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776291200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788197519.251175:0:11184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.251192:0:11184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.251197:0:11184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7000/0x167e6c29240300b6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197519.983138:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197520.622640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197520.622717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282816 00000100:00100000:2.0:1788197520.622727:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282816 00000100:00100000:2.0:1788197520.622779:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 232 00000100:00100000:2.0:1788197520.622788:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+11:5600:x1875060755282816:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197520.622804:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197520.622953:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d56e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197520.622993:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197520.623005:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197520.623014:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197520.623068:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755282816:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 281us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197520.623074:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 232 00000100:00100000:1.0:1788197520.644004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197520.644140:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755282944 00000100:00100000:3.0:1788197520.644150:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755282944 00000100:00100000:3.0:1788197520.644210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:3.0:1788197520.644221:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755282944:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197520.644495:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755282944:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 275us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197520.644504:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:3.0:1788197520.649100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197520.649173:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283072 00000100:00100000:0.0:1788197520.649183:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283072 00000100:00100000:0.0:1788197520.649249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 234 00000100:00100000:0.0:1788197520.649259:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755283072:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.649480:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755283072:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 222us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.649489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 234 00000100:00100000:1.0:1788197520.662151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197520.662991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283200 00000100:00100000:0.0:1788197520.663003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283200 00000100:00100000:0.0:1788197520.663097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 235 00000100:00100000:0.0:1788197520.663107:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755283200:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197520.663143:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197520.663160:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d56eb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.663212:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.663226:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.663235:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:0.0:1788197520.663295:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755283200:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 190us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.663303:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 235 00000100:00100000:0.0:1788197520.667430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197520.667547:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283328 00000100:00100000:3.0:1788197520.667556:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283328 00000100:00100000:3.0:1788197520.667606:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:3.0:1788197520.667616:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755283328:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197520.667992:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755283328:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 376us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197520.668000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:3.0:1788197520.672201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197520.673335:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283456 00000100:00100000:0.0:1788197520.673345:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283456 00000100:00100000:0.0:1788197520.673409:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 237 00000100:00100000:0.0:1788197520.673420:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755283456:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.673638:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755283456:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 219us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.673646:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 237 10000000:01000000:0.0:1788197520.877985:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788197520.877992:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c736929000 from 7 10000000:01000000:0.0:1788197520.877996:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197520.878044:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.878072:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.878084:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197520.878105:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.878165:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.878212:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add300 going to sleep for 11 seconds 00000100:00100000:3.0:1788197520.878323:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291328 00000100:00100000:3.0:1788197520.878330:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291328 00000100:00100000:3.0:1788197520.878372:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788197520.878388:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776291328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197520.878402:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197520.878413:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240300cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197520.878436:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240300cb expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197520.878447:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240300cb expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197520.878456:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7000, rc 0) 00000100:00100000:3.0:1788197520.878492:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776291328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197520.878498:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788197520.878798:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197520.878813:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.878836:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197520.878893:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.878919:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.878938:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add300 going to sleep for 11 seconds 00000100:00100000:3.0:1788197520.879146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291456 00000100:00100000:3.0:1788197520.879150:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291456 00000100:00100000:3.0:1788197520.879181:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788197520.879188:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776291456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197520.879437:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776291456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197520.879445:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788197520.879522:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197520.879556:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788197520.879598:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197520.879630:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741481c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788197520.879680:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291584 00000100:00100000:0.0:1788197520.879684:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291584 00000100:00100000:0.0:1788197520.879713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788197520.879720:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776291584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.879870:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776291584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.879877:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788197520.879914:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788197520.880605:0:11240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788197520.880658:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788197520.880673:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197520.880681:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.880691:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197520.880700:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788197520.880702:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c70f634000 from 7 10000000:01000000:0.0:1788197520.880705:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197520.880728:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.880735:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.880744:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197520.880759:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.880792:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.880808:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add180 going to sleep for 11 seconds 00000100:00100000:0.0:1788197520.880842:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291712 00000100:00100000:0.0:1788197520.880847:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291712 00000100:00100000:0.0:1788197520.880869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788197520.880875:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776291712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197520.880896:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197520.880907:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240300d9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.880924:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240300d9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.880933:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240300d9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.880941:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030400, rc 0) 00000100:00100000:0.0:1788197520.880981:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776291712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.880987:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788197520.881012:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197520.881023:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.881031:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197520.881063:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.881081:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.881091:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add180 going to sleep for 11 seconds 00000100:00100000:0.0:1788197520.881100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291840 00000100:00100000:0.0:1788197520.881103:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291840 00000100:00100000:0.0:1788197520.881116:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788197520.881120:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776291840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.881304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776291840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.881312:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788197520.881335:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.881357:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.881389:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.881400:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add180 going to sleep for 11 seconds 00000100:00100000:0.0:1788197520.881410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776291968 00000100:00100000:0.0:1788197520.881413:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776291968 00000100:00100000:0.0:1788197520.881426:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788197520.881431:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776291968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.881545:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776291968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.881551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788197520.889964:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776291968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788197520.894419:0:11241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788197520.894864:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788197520.894888:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197520.894899:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.894910:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197520.894920:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788197520.894922:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c706bce800 from 7 10000000:01000000:0.0:1788197520.894925:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197520.894989:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.894997:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.895008:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197520.895314:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776292096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.895385:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.895426:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add180 going to sleep for 11 seconds 00000100:00100000:1.0:1788197520.895913:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292096 00000100:00100000:1.0:1788197520.895922:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292096 00000100:00100000:1.0:1788197520.895987:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788197520.895998:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776292096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788197520.896014:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197520.896045:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240300e7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197520.896072:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240300e7 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197520.896082:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240300e7 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197520.896090:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387a00, rc 0) 00000100:00100000:1.0:1788197520.896138:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776292096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197520.896145:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788197520.896359:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776292096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197520.896375:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.896384:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197520.896436:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776292224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.896462:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.896492:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add180 going to sleep for 11 seconds 00000100:00100000:1.0:1788197520.896643:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292224 00000100:00100000:1.0:1788197520.896648:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292224 00000100:00100000:1.0:1788197520.896678:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788197520.896684:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776292224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197520.896938:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776292224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197520.896945:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788197520.897022:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776292224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.897057:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776292352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.897094:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197520.897120:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add180 going to sleep for 11 seconds 00000100:00100000:0.0:1788197520.897131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292352 00000100:00100000:0.0:1788197520.897141:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292352 00000100:00100000:0.0:1788197520.897164:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788197520.897171:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776292352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197520.897310:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776292352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197520.897317:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788197520.897352:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776292352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788197520.898037:0:11242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788197520.898088:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788197520.898103:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197520.898111:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197520.898121:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197521.005935:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197521.525803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197521.525867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197521.525891:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283584 00000100:00100000:3.0:1788197521.525900:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283584 00000100:00100000:3.0:1788197521.525949:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283712 00000100:00100000:2.0:1788197521.526071:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:3.0:1788197521.526121:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283712 00000100:00100000:2.0:1788197521.526159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755283584:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197521.526167:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:3.0:1788197521.526174:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755283712:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197521.526354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755283712:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 179us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197521.526363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00080000:3.0:1788197521.526384:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197521.526770:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755283584:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 615us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197521.526778:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 95 00010000:00010000:1.0:1788197522.046197:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788197523.043047:0:11382:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788197523.055666:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197523.311974:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776292480:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312054:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197523.312105:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776292992:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197523.312158:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197523.312164:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776292864:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197523.312251:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776292608:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197523.312294:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776293120:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197523.312331:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788197523.312336:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776292736:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312358:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197523.312410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292480 00000100:00100000:2.0:1788197523.312419:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292480 00000100:00100000:2.0:1788197523.312476:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788197523.312486:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776292480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312536:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776292480:12345-0@lo:400:kworker.0 Request processed in 52us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197523.312552:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788197523.312585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292992 00000100:00100000:2.0:1788197523.312589:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292992 00000100:00100000:2.0:1788197523.312623:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292608 00000100:00100000:2.0:1788197523.312800:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292608 00000100:00100000:2.0:1788197523.312844:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292736 00000100:00100000:2.0:1788197523.312849:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292736 00000100:00100000:2.0:1788197523.312867:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788197523.312874:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776292992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776292992:12345-0@lo:400:kworker.0 Request processed in 35us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197523.312915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788197523.312926:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788197523.312933:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776292608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.312984:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776292608:12345-0@lo:400:kworker.0 Request processed in 52us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197523.312991:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788197523.313004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788197523.313010:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776292736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197523.313022:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776292608:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.313037:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776292736:12345-0@lo:400:kworker.0 Request processed in 28us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197523.313042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788197523.313045:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776292736:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.313059:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776292864 00000100:00100000:2.0:1788197523.313062:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776292864 00000100:00100000:2.0:1788197523.313098:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776293120 00000100:00100000:2.0:1788197523.313101:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776293120 00000100:00100000:2.0:1788197523.313124:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788197523.313139:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776292864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.313174:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776292864:12345-0@lo:400:kworker.0 Request processed in 36us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197523.313180:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788197523.313193:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788197523.313199:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776293120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.313232:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776293120:12345-0@lo:400:kworker.0 Request processed in 33us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197523.313237:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788197523.313265:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197523.313269:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197523.313271:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788197523.313295:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c280e00 x1875060776293120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197523.313306:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776293120:0@lo:400:kworker.0 00010000:00080000:2.0:1788197523.313330:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c282300 x1875060776292864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197523.313339:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776292864:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.313347:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776292480:0@lo:400:kworker.0 00000100:00100000:2.0:1788197523.313356:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776292992:0@lo:400:kworker.0 00000100:00100000:0.0:1788197523.823010:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776293248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197523.823084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197523.823254:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776293248 00000100:00100000:3.0:1788197523.823264:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776293248 00000100:00100000:3.0:1788197523.823321:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788197523.823333:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776293248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197523.823370:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197523.823425:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776293248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197523.823434:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788197523.823665:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c74133f480 x1875060776293248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197523.823684:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776293248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788197524.079250:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197524.343318:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776293376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197524.343381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197524.343461:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776293376 00000100:00100000:2.0:1788197524.343468:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776293376 00000100:00100000:2.0:1788197524.343520:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788197524.343529:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776293376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788197524.343558:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197524.343597:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776293376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197524.343605:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788197524.343655:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c74133d180 x1875060776293376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197524.343673:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776293376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788197525.106185:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197526.126808:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197526.643673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197526.643727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197526.643750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197526.643784:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755284096 00000100:00100000:2.0:1788197526.643795:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755284096 00000100:00100000:2.0:1788197526.643891:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283968 00000100:00100000:2.0:1788197526.643895:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283968 00000100:00100000:2.0:1788197526.643932:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:2.0:1788197526.643944:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755284096:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197526.644020:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755284096:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197526.644027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:2.0:1788197526.644047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:2.0:1788197526.644054:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755283968:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197526.644074:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755283968:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 21us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197526.644098:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00080000:2.0:1788197526.644116:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197526.646280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755283840 00000100:00100000:3.0:1788197526.646291:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755283840 00000100:00100000:3.0:1788197526.646347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 248 00000100:00100000:3.0:1788197526.646356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755283840:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197526.646413:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755283840:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 59us (2756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197526.646420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 248 00000001:02000400:0.0:1788197527.051444:0:11482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:32:04 (1788197524) === 00010000:00010000:3.0:1788197527.150774:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197527.319476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.319525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197527.319903:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755284352 00000100:00100000:0.0:1788197527.319914:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755284352 00000100:00100000:0.0:1788197527.320042:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:2.0:1788197527.320057:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755284224 00000100:00100000:2.0:1788197527.320064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755284224 00000100:00100000:0.0:1788197527.320069:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:9692:x1875060755284352:12345-192.168.206.40@tcp:700:mkdir.0 00000100:00100000:2.0:1788197527.320118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1788197527.320127:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2358:x1875060755284224:12345-192.168.206.40@tcp:41:mkdir.0 00000004:00000024:2.0:1788197527.320161:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788197527.320181:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9692:x1875060755284352:12345-192.168.206.40@tcp:700:mkdir.0 Request processed in 115us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197527.320190:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:2.0:1788197527.320367:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755284224:12345-192.168.206.40@tcp:41:mkdir.0 Request processed in 240us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197527.320374:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1788197527.323581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.323674:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755284608 00000100:00100000:3.0:1788197527.323697:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755284608 00000100:00100000:3.0:1788197527.323756:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1788197527.323766:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:9692:x1875060755284608:12345-192.168.206.40@tcp:36:mkdir.0 00010000:00010000:3.0:1788197527.323857:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197527.323943:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c292402ffd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d566d expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.323963:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:3.0:1788197527.323973:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197527.324529:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.324544:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.324555:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.324586:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.324593:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.324600:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197527.326975:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788197527.326992:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.327002:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.327015:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.327563:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197527.327570:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.327579:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.327595:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c7065f6100) 00010000:00010000:3.0:1788197527.327599:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197527.327604:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.327611:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240300f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788197527.327635:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d73b72f4 reply state 0000000014e75cdd transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197527.327644:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788197527.327737:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9692:x1875060755284608:12345-192.168.206.40@tcp:36:mkdir.0 Request processed in 3970us (4163us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788197527.327746:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00010000:00010000:1.0:1788197527.336294:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.336311:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.336319:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.336325:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197527.336330:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.336337:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.336362:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c7065f6f00) 00010000:00010000:1.0:1788197527.336365:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197527.336370:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.336376:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240300fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197527.357997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197527.359788:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755284736 00000100:00100000:1.0:1788197527.359804:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755284736 00000100:00100000:1.0:1788197527.359929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:1.0:1788197527.359942:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:9693:x1875060755284736:12345-192.168.206.40@tcp:101:chmod.0 00010000:00010000:1.0:1788197527.359965:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197527.359986:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d56f2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.360056:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c292403010a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.360070:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c292403010a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.360080:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c292403010a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197527.360112:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788197527.360115:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197527.360153:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c292403010a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.360178:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56f2 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.360314:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c292403010a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56f2 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.360324:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46b00) 00010000:00010000:1.0:1788197527.360341:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788197527.360345:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386600, rc 0) 00000100:00100000:1.0:1788197527.360412:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9693:x1875060755284736:12345-192.168.206.40@tcp:101:chmod.0 Request processed in 473us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197527.360420:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:2.0:1788197527.364948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197527.365265:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755284992 00000100:00100000:0.0:1788197527.365275:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755284992 00000100:00100000:0.0:1788197527.365332:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1788197527.365343:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9693:x1875060755284992:12345-192.168.206.40@tcp:36:chmod.0 00010000:00010000:0.0:1788197527.365395:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197527.365421:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c292403010a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56f2 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.365442:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46b00) 00010000:00010000:0.0:1788197527.365452:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197527.365476:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.365490:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.365499:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788197527.365796:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068296895 reply state 00000000b5d61c41 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197527.365806:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788197527.365812:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788197527.366120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:9693:x1875060755284992:12345-192.168.206.40@tcp:36:chmod.0 Request processed in 778us (1180us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788197527.366201:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00010000:00010000:3.0:1788197527.371454:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.371474:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.371497:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.371504:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197527.371509:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.371517:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.371533:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:3.0:1788197527.371537:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788197527.371542:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.371548:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030111 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197527.391395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197527.391485:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755285120 00000100:00100000:1.0:1788197527.391493:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755285120 00000100:00100000:1.0:1788197527.391545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1788197527.391553:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9694:x1875060755285120:12345-192.168.206.40@tcp:101:chown.0 00010000:00010000:1.0:1788197527.391573:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197527.391592:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d56f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.391652:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403011f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.391663:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403011f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.391672:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403011f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197527.391701:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788197527.391704:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197527.391740:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403011f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.391765:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56f9 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.391803:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403011f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56f9 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.391812:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46900) 00010000:00010000:1.0:1788197527.391815:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788197527.391819:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387e00, rc 0) 00000100:00100000:1.0:1788197527.392064:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:9694:x1875060755285120:12345-192.168.206.40@tcp:101:chown.0 Request processed in 510us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197527.392071:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:0.0:1788197527.394732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197527.394849:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755285248 00000100:00100000:2.0:1788197527.394859:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755285248 00000100:00100000:2.0:1788197527.394918:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1788197527.394938:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:9694:x1875060755285248:12345-192.168.206.40@tcp:101:chown.0 00010000:00010000:2.0:1788197527.394958:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197527.394978:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5700 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395036:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395048:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395074:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395088:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395094:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395101:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395192:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403013b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395201:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403013b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395207:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403013b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197527.395232:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788197527.395236:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197527.395254:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403013b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395266:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395272:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395289:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395295:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197527.395299:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395307:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395319:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46900) 00010000:00010000:2.0:1788197527.395322:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197527.395326:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395332:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403012d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395345:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395351:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395357:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395362:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197527.395364:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395379:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395387:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c7028a4000) 00010000:00010000:2.0:1788197527.395389:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197527.395391:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395397:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030134 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395426:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5700 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395437:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403013b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5700 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.395444:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:2.0:1788197527.395447:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788197527.395449:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d800, rc 0) 00000100:00100000:2.0:1788197527.395506:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:9694:x1875060755285248:12345-192.168.206.40@tcp:101:chown.0 Request processed in 570us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197527.395513:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1788197527.399079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197527.399410:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755285504 00000100:00100000:0.0:1788197527.399420:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755285504 00000100:00100000:0.0:1788197527.399477:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:0.0:1788197527.399487:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:9694:x1875060755285504:12345-192.168.206.40@tcp:36:chown.0 00010000:00010000:0.0:1788197527.399536:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197527.399561:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403013b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5700 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.399578:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:0.0:1788197527.399589:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197527.399614:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.399626:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.399635:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197527.433788:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788197527.433985:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033523c92 reply state 00000000c773d6be transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197527.433998:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788197527.434011:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788197527.434207:0:5841:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788197527.434229:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9694:x1875060755285504:12345-192.168.206.40@tcp:36:chown.0 Request processed in 34740us (35155us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788197527.434254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00010000:00010000:1.0:1788197527.434334:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.434343:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.434351:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.434357:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197527.434361:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.434368:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.434382:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197527.434385:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788197527.434389:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.434403:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030142 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197527.452350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197527.452505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755285632 00000100:00100000:0.0:1788197527.452515:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755285632 00000100:00100000:0.0:1788197527.452572:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:0.0:1788197527.452582:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:9695:x1875060755285632:12345-192.168.206.40@tcp:101:touch.500 00010000:00010000:0.0:1788197527.452604:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197527.452623:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5707 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788197527.453844:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1171us 00010000:00010000:2.0:1788197527.469697:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.469997:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470011:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470028:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470038:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470043:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470416:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403015e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470424:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403015e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470433:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403015e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197527.470454:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788197527.470458:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197527.470491:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403015e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470502:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470517:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470523:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470529:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197527.470533:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470540:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470551:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46900) 00010000:00010000:2.0:1788197527.470554:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197527.470557:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470563:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470574:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470656:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470663:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470668:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197527.470677:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470683:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470692:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c7028a4000) 00010000:00010000:2.0:1788197527.470695:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197527.470697:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470704:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470805:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5707 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470843:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403015e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5707 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.470851:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:2.0:1788197527.470853:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788197527.470856:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d200, rc 0) 00000100:00100000:2.0:1788197527.470999:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9695:x1875060755285632:12345-192.168.206.40@tcp:101:touch.500 Request processed in 18416us (18656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197527.471009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1788197527.473927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197527.474964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755285888 00000100:00100000:1.0:1788197527.474975:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755285888 00000100:00100000:1.0:1788197527.475031:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:1.0:1788197527.475041:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:9695:x1875060755285888:12345-192.168.206.40@tcp:101:touch.500 00010000:00010000:1.0:1788197527.475058:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197527.475075:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030165 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d570e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.475321:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.475334:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.475345:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.475357:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.475364:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.475370:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788197527.478744:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788197527.479096:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403017a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479113:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403017a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479124:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403017a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479160:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479167:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479174:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479181:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197527.479185:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479193:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479204:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:1.0:1788197527.479207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197527.479211:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479216:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403016c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197527.479238:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb0b6511 reply state 0000000082b5d317 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197527.479247:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788197527.479284:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030165 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d570e expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479300:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403017a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d570e expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.479308:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c704a46d00) 00010000:00010000:1.0:1788197527.479310:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197527.479313:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7420c2a00, rc 0) 00000100:00100000:1.0:1788197527.479393:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:9695:x1875060755285888:12345-192.168.206.40@tcp:101:touch.500 Request processed in 4352us (5483us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788197527.479403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00010000:00010000:1.0:1788197527.482663:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.482681:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.482688:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.482694:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197527.482699:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.482724:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.482741:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff93c704a46000) 00010000:00010000:1.0:1788197527.482744:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197527.482806:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.482814:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030173 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197527.483256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.483445:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755286144 00000100:00100000:3.0:1788197527.483455:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755286144 00000100:00100000:3.0:1788197527.483509:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:3.0:1788197527.483519:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:9695:x1875060755286144:12345-192.168.206.40@tcp:36:touch.500 00010000:00010000:3.0:1788197527.483574:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197527.483667:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403017a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d570e expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.483682:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c704a46d00) 00010000:00010000:3.0:1788197527.483689:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197527.483729:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.483750:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.483760:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788197527.484138:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b07598f reply state 000000005a534f0e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197527.484148:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788197527.484238:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:9695:x1875060755286144:12345-192.168.206.40@tcp:36:touch.500 Request processed in 720us (985us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788197527.484246:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:0.0:1788197527.489200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197527.489252:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755286272 00000100:00100000:2.0:1788197527.489262:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755286272 00010000:00010000:3.0:1788197527.489267:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.489279:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.489286:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.489291:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197527.489296:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.489304:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.489322:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c7065f6100) 00010000:00010000:3.0:1788197527.489337:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197527.489342:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.489349:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030188 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197527.489492:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:2.0:1788197527.489504:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:9695:x1875060755286272:12345-192.168.206.40@tcp:101:touch.500 00010000:00010000:2.0:1788197527.489530:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197527.489553:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403018f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5715 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.489614:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403018f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5715 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.489698:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403018f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5715 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.489727:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:2.0:1788197527.489729:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197527.489740:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155da00, rc 0) 00000100:00100000:2.0:1788197527.489817:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:9695:x1875060755286272:12345-192.168.206.40@tcp:101:touch.500 Request processed in 315us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197527.489849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:2.0:1788197527.494498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.494586:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755286400 00000100:00100000:3.0:1788197527.494597:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755286400 00000100:00100000:3.0:1788197527.494761:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1788197527.494770:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1875060755286400:12345-192.168.206.40@tcp:8:touch.500 00010000:00080000:3.0:1788197527.494810:0:8021:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1788197527.494885:0:8021:0:(genops.c:1385:class_connect()) connect: client 87c79f47-cb13-4c8a-942c-8f23eb455b39, cookie 0x167e6c2924030196 00002000:00100000:3.0:1788197527.494898:0:8021:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 87c79f47-cb13-4c8a-942c-8f23eb455b39/ffff93c706742800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788197527.494932:0:8021:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788197527.495181:0:8021:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788197527.495231:0:8021:0:(import.c:65:import_set_state_nolock()) ffff93c740fe9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197527.495291:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2356:x1875060755286400:12345-192.168.206.40@tcp:8:touch.500 Request processed in 519us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197527.495299:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:0.0:1788197527.498736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197527.499109:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755286528 00000100:00100000:2.0:1788197527.499119:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755286528 00000100:00100000:2.0:1788197527.499283:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:2.0:1788197527.499293:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:0:x1875060755286528:12345-192.168.206.40@tcp:2:touch.500 00000100:00080000:0.0:1788197527.503219:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788197527.563065:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1788197527.563085:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000100:00100000:1.0:1788197527.563881:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:0:x1875060755286528:12345-192.168.206.40@tcp:2:touch.500 Request processed in 64582us (65148us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788197527.563899:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1788197527.568729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197527.568880:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755286784 00000100:00100000:2.0:1788197527.568890:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755286784 00000100:00100000:2.0:1788197527.568952:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1788197527.568962:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:9695:x1875060755286784:12345-192.168.206.40@tcp:35:touch.500 00000100:00100000:2.0:1788197527.569437:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:9695:x1875060755286784:12345-192.168.206.40@tcp:35:touch.500 Request processed in 475us (718us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788197527.569445:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1788197527.589518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197527.590029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755286912 00000100:00100000:0.0:1788197527.590040:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755286912 00000100:00100000:0.0:1788197527.590103:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1788197527.590114:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:9696:x1875060755286912:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:0.0:1788197527.590150:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197527.590170:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403019d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d571c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.590235:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240301a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.590249:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240301a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.590286:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240301a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197527.590318:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788197527.590322:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197527.590357:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240301a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.590383:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403019d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d571c expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.590402:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240301a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d571c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.590411:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:0.0:1788197527.590414:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197527.590417:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031800, rc 0) 00000100:00100000:0.0:1788197527.590479:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:9696:x1875060755286912:12345-192.168.206.40@tcp:101:rm.0 Request processed in 367us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197527.590486:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:1.0:1788197527.606101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.606396:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755287168 00000100:00100000:3.0:1788197527.606407:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755287168 00000100:00100000:3.0:1788197527.606464:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:3.0:1788197527.606474:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:9696:x1875060755287168:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:3.0:1788197527.606494:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197527.606511:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5723 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197527.606624:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788197527.607043:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5723 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.607059:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46900) 00010000:00010000:3.0:1788197527.607062:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788197527.607067:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5723 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.607081:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6e00, rc 0) 00000100:00100000:3.0:1788197527.607131:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:9696:x1875060755287168:12345-192.168.206.40@tcp:101:rm.0 Request processed in 658us (1040us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788197527.607138:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:1.0:1788197527.622188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197527.622550:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755287296 00000100:00100000:2.0:1788197527.622561:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755287296 00000100:00100000:2.0:1788197527.622614:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:2.0:1788197527.622635:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:9696:x1875060755287296:12345-192.168.206.40@tcp:37:rm.0 00000100:00100000:2.0:1788197527.638556:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:9696:x1875060755287296:12345-192.168.206.40@tcp:37:rm.0 Request processed in 15910us (16365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197527.638571:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:2.0:1788197527.646294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.646428:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755287552 00000100:00100000:3.0:1788197527.646437:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755287552 00000100:00100000:3.0:1788197527.646481:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:3.0:1788197527.646490:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7048c3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:9696:x1875060755287552:12345-192.168.206.40@tcp:35:rm.0 00000100:00100000:3.0:1788197527.647039:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7048c3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:9696:x1875060755287552:12345-192.168.206.40@tcp:35:rm.0 Request processed in 547us (751us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788197527.647048:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:1.0:1788197527.652279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197527.652386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755287808 00000100:00100000:0.0:1788197527.652396:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755287808 00000100:00100000:0.0:1788197527.652482:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:0.0:1788197527.652492:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:9696:x1875060755287808:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:0.0:1788197527.652513:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197527.652531:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240301b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d572a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.652647:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240301c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.652660:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240301c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.652671:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240301c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197527.652681:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788197527.652799:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240301b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d572a expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.652817:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240301c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d572a expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197527.652999:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:0.0:1788197527.653002:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788197527.653005:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031600, rc 0) 00000100:00100000:1.0:1788197527.653115:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:9696:x1875060755287808:12345-192.168.206.40@tcp:101:rm.0 Request processed in 623us (843us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788197527.653123:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:1.0:1788197527.670081:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.673963:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755287936 00000100:00100000:3.0:1788197527.673979:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755287936 00000100:00100000:2.0:1788197527.674158:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:2.0:1788197527.674173:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:9696:x1875060755287936:12345-192.168.206.40@tcp:41:rm.0 00000004:00000024:2.0:1788197527.674234:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788197527.674308:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:9696:x1875060755287936:12345-192.168.206.40@tcp:41:rm.0 Request processed in 138us (4237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197527.674316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:0.0:1788197527.679787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197527.680011:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755288064 00000100:00100000:3.0:1788197527.680020:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755288064 00000100:00100000:3.0:1788197527.680080:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:3.0:1788197527.680090:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:9696:x1875060755288064:12345-192.168.206.40@tcp:101:rm.0 00010000:00010000:3.0:1788197527.680123:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197527.680155:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240301ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5731 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680216:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680231:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680243:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680257:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680264:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680271:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680391:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240301e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680400:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240301e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680408:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240301e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197527.680433:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788197527.680443:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197527.680462:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240301e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680473:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240301e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680481:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680487:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680494:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680501:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197527.680505:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680513:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680525:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:3.0:1788197527.680529:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197527.680533:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680541:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240301d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680554:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680571:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680577:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680582:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197527.680585:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680592:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680601:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff93c7065f6100) 00010000:00010000:3.0:1788197527.680603:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197527.680606:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680612:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c29240301dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680641:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240301ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5731 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680653:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240301e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5731 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.680661:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:3.0:1788197527.680664:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788197527.680672:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6800, rc 0) 00000100:00100000:3.0:1788197527.681037:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:9696:x1875060755288064:12345-192.168.206.40@tcp:101:rm.0 Request processed in 945us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197527.681044:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:1.0:1788197527.689798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197527.689900:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755288320 00000100:00100000:2.0:1788197527.689911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755288320 00000100:00100000:2.0:1788197527.689973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:2.0:1788197527.689983:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:9696:x1875060755288320:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:2.0:1788197527.690151:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788197527.690180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240301e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5731 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690224:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403018f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5715 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690236:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:2.0:1788197527.690250:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240301a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d571c expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690259:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:2.0:1788197527.690262:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197527.690282:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690294:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690304:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690318:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690325:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690330:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690474:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690493:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.690500:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197527.691286:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788197527.691298:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323837474959ns, next at 324837472535ns, rc = 0 00010000:00010000:2.0:1788197527.691355:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691365:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691373:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691380:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691387:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691393:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691417:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197527.691435:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691441:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691454:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691460:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197527.691465:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691473:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691484:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197527.691487:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788197527.691491:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691497:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240301f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691512:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691518:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691523:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691527:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197527.691529:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691545:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691553:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:2.0:1788197527.691555:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197527.691557:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197527.691562:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c29240301ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197527.691571:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092dd1a88 reply state 000000000bb55c17 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197527.691579:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197527.691658:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:9696:x1875060755288320:12345-192.168.206.40@tcp:36:rm.0 Request processed in 1672us (1868us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788197527.691666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00010000:00010000:1.0:1788197527.694027:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197527.694041:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.695152:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.695167:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.695174:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.695180:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197527.695184:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.695192:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.695208:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff93c7028a4200) 00010000:00010000:3.0:1788197527.695211:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197527.695214:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.695221:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240301f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197527.698247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:1.0:1788197527.698865:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197527.698870:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.698891:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.698908:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197527.698911:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788197527.698916:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.698931:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240301ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.698957:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197527.698960:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197527.698963:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197527.698977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755288576 00000100:00100000:0.0:1788197527.698997:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755288576 00000100:00100000:0.0:1788197527.699059:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1788197527.699070:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:9696:x1875060755288576:12345-192.168.206.40@tcp:35:rm.0 00000100:00100000:0.0:1788197527.699275:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:9696:x1875060755288576:12345-192.168.206.40@tcp:35:rm.0 Request processed in 206us (1037us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788197527.699283:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:2.0:1788197527.702692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197527.702816:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755288832 00000100:00100000:1.0:1788197527.702860:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755288832 00000100:00100000:1.0:1788197527.702916:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:1.0:1788197527.702936:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:9696:x1875060755288832:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:1.0:1788197527.702999:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788197527.703029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240301c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d572a expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703054:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403015e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5707 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703067:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:1.0:1788197527.703083:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403011f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56f9 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703108:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46900) 00010000:00010000:1.0:1788197527.703115:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197527.703150:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703162:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703172:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703184:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703192:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703199:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703427:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703436:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.703444:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197527.704096:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788197527.704117:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704130:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704136:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704141:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197527.704146:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704153:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704164:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93c704a46d00) 00010000:00010000:1.0:1788197527.704166:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788197527.704171:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704177:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030214 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704197:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704203:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704210:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704214:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7420c3e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197527.704224:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704230:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704239:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46000) 00010000:00010000:1.0:1788197527.704241:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197527.704244:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197527.704251:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030206 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197527.704263:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011611c58 reply state 000000005de3f244 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197527.704271:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788197527.704346:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:9696:x1875060755288832:12345-192.168.206.40@tcp:36:rm.0 Request processed in 1410us (1661us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788197527.704354:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00010000:00010000:3.0:1788197527.712010:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.712046:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.712053:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.712058:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7420c2a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197527.712063:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.712071:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.712086:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93c704a46c00) 00010000:00010000:3.0:1788197527.712089:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197527.712094:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197527.712100:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c292403020d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197528.174397:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197528.431977:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776293760:0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.432047:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197528.432106:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788197528.432113:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776293632:0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.432138:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197528.432156:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.432179:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197528.432217:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776293760 00000100:00100000:0.0:1788197528.432225:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776293760 00000100:00100000:0.0:1788197528.432270:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776293632 00000100:00100000:0.0:1788197528.432274:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776293632 00000100:00100000:0.0:1788197528.432296:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788197528.432304:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776293760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.432356:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776293760:12345-0@lo:400:kworker.0 Request processed in 53us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197528.432363:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788197528.432377:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788197528.432383:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776293632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.432424:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776293632:12345-0@lo:400:kworker.0 Request processed in 36us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197528.432431:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788197528.432449:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294144 00000100:00100000:0.0:1788197528.432452:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294144 00000100:00100000:0.0:1788197528.432476:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788197528.432481:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776294144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.432507:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776294144:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197528.432520:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788197528.432538:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197528.432542:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197528.432566:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776293632:0@lo:400:kworker.0 00010000:00080000:0.0:1788197528.432578:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c707c00380 x1875060776294144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197528.432601:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.432610:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776293760:0@lo:400:kworker.0 00000100:00100000:3.0:1788197528.432849:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776293888:0@lo:400:kworker.0 00000100:00100000:3.0:1788197528.432881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197528.432925:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788197528.432932:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776293504:0@lo:400:kworker.0 00000100:00100000:3.0:1788197528.432958:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197528.432979:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776294016:0@lo:400:kworker.0 00000100:00100000:3.0:1788197528.432999:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197528.433031:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776293504 00000100:00100000:3.0:1788197528.433035:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776293504 00000100:00100000:3.0:1788197528.433061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788197528.433068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776293504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197528.433107:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776293504:12345-0@lo:400:kworker.0 Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197528.433113:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788197528.433147:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776293504:0@lo:400:kworker.0 00000100:00100000:1.0:1788197528.433231:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294016 00000100:00100000:1.0:1788197528.433236:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294016 00000100:00100000:1.0:1788197528.433280:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788197528.433287:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776294016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197528.433334:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776294016:12345-0@lo:400:kworker.0 Request processed in 40us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197528.433340:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788197528.433365:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776294016:0@lo:400:kworker.0 00000100:00080000:3.0:1788197528.433858:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197528.434852:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776293888 00000100:00100000:0.0:1788197528.434862:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776293888 00000100:00100000:0.0:1788197528.434936:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788197528.434945:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776293888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197528.435007:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776293888:12345-0@lo:400:kworker.0 Request processed in 63us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197528.435014:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788197528.435118:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c6066ddf80 x1875060776293888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197528.435139:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776293888:0@lo:400:kworker.0 00000100:00080000:3.0:1788197528.435209:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197528.942197:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197528.942222:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776294272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197528.942303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197528.942471:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294272 00000100:00100000:3.0:1788197528.942479:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294272 00000100:00100000:3.0:1788197528.942531:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788197528.942541:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776294272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197528.942573:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197528.942619:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776294272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197528.942627:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788197528.942734:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736ac8a80 x1875060776294272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197528.942753:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776294272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197529.198429:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788197529.454164:0:7124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325600338419ns, next at 326600335964ns, rc = 0 00000100:00100000:0.0:1788197529.454257:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776294400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197529.454323:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197529.454451:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294400 00000100:00100000:3.0:1788197529.454459:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294400 00000100:00100000:3.0:1788197529.454514:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788197529.454534:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776294400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197529.454568:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197529.454612:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776294400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197529.454636:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788197529.454736:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736acaa00 x1875060776294400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197529.454753:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776294400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788197530.223040:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197531.251300:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197531.784634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197531.784745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197531.784782:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197531.784852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197531.785035:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289216 00000100:00100000:0.0:1788197531.785046:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289216 00000100:00100000:0.0:1788197531.785112:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:0.0:1788197531.785132:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755289216:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197531.785201:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755289216:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 72us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197531.785222:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:3.0:1788197531.785608:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755288960 00000100:00100000:3.0:1788197531.785613:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755288960 00000100:00100000:3.0:1788197531.785643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 250 00000100:00100000:3.0:1788197531.785650:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755288960:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197531.785699:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755288960:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 49us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197531.785706:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 250 00000100:00080000:3.0:1788197531.785734:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197531.794348:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289088 00000100:00100000:1.0:1788197531.794365:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289088 00000100:00100000:1.0:1788197531.794441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289344 00000100:00100000:1.0:1788197531.794445:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289344 00000100:00100000:1.0:1788197531.794478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:1.0:1788197531.794487:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2360:x1875060755289088:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197531.794564:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2360:x1875060755289088:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (9940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197531.794572:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:1.0:1788197531.794590:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00100000:1.0:1788197531.794597:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755289344:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197531.794626:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755289344:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (9774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197531.794632:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00080000:1.0:1788197531.794651:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788197531.907306:0:11631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788197532.270047:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788197532.582526:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:3.0:1788197532.582545:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788197532.582556:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:3.0:1788197532.582572:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1788197532.582698:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776294528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788197532.582760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197532.582857:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294528 00000100:00100000:3.0:1788197532.582864:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294528 00000100:00100000:3.0:1788197532.582930:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788197532.582939:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776294528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788197532.582963:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788197532.583000:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a95ba97, atime: 0x6a95ba97, ctime: 0x6a95ba97, blocks: 0x1 00010000:00010000:3.0:1788197532.583008:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583024:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1788197532.583034:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197532.583040:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583057:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583067:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583075:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583093:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788197532.583565:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776294528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 625us (802us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788197532.583574:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788197532.583597:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788197532.583610:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197532.583616:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583625:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197532.583629:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583638:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583661:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583669:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c292403021b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197532.583685:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197532.583687:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197532.583688:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788197532.583717:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c736ac8e00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788197532.583723:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776294528:0@lo:6:osp-syn-0-0.0 00000020:00000080:0.0:1788197532.977759:0:11681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc354e910 20000000:00000080:0.0:1788197532.977775:0:11681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c706b2a800 uarg=0000000000000000 20000000:01000000:0.0:1788197532.977813:0:11681:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788197532.977819:0:11681:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788197532.977842:0:11681:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788197532.980616:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788197532.980965:0:11681:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788197532.990804:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788197532.990907:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788197532.990965:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788197532.990983:0:11681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788197532.991003:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991021:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991029:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991037:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240300cb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991043:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240300d9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991062:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240300e7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991069:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991754:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c29240300e7 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197532.991771:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c29240300e7 expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197532.991787:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c707c01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776294656:0@lo:104: 00000100:00100000:1.0:1788197532.991990:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197532.992151:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c29240300d9 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197532.992162:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c29240300d9 expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197532.992171:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776294784:0@lo:104: 00000100:00100000:1.0:1788197532.992196:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197532.998931:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c29240300cb expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197532.998949:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c29240300cb expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197532.998964:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776294912:0@lo:104: 00000100:00100000:1.0:1788197532.999028:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197533.003224:0:8525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294656 00000100:00100000:3.0:1788197533.003239:0:8525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294656 00000100:00100000:2.0:1788197533.007644:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294784 00000100:00100000:2.0:1788197533.007659:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294784 00000100:00100000:2.0:1788197533.007757:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788197533.007767:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:11681:x1875060776294784:12345-0@lo:104: 00010000:00010000:2.0:1788197533.007785:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197533.007914:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197533.007920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:11681:x1875060776294784:12345-0@lo:104: Request processed in 155us (15724us total) trans 0 rc 0/0 00010000:00010000:1.0:1788197533.007974:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.007990:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 12 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197533.009035:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776295040:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197533.009128:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009139:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197533.009165:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776295168:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197533.009187:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c703e76780 going to sleep for 10 seconds 00000100:00100000:1.0:1788197533.009212:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776294784:0@lo:104: 00000100:00100000:0.0:1788197533.009237:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788197533.009253:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788197533.009254:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776294912 00000100:00100000:0.0:1788197533.009262:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776294912 00010000:00010000:1.0:1788197533.009263:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009271:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030a00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:1.0:1788197533.009275:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009285:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.009292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 10000000:00010000:1.0:1788197533.009296:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.009305:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:11681:x1875060776294912:12345-0@lo:104: 10000000:01000000:1.0:1788197533.009307:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788197533.009321:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009341:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009349:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788197533.009373:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009381:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700030a00/0x167e6c29240300d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300e0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.009390:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788197533.009400:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+5:11681:x1875060776294912:12345-0@lo:104: Request processed in 97us (10371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197533.009409:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788197533.009413:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197533.009417:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009423:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:1.0:1788197533.009427:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009434:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.009442:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:00010000:1.0:1788197533.009456:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.009456:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776295296:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788197533.009467:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788197533.009490:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.009491:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197533.009499:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788197533.009509:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009515:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700031200/0x167e6c29240300cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300d2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009530:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197533.009532:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197533.009534:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197533.009542:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776295424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197533.009565:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776294912:0@lo:104: 00000100:00100000:0.0:1788197533.009576:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197533.009619:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776295296 00000100:00100000:0.0:1788197533.009623:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776295296 00000100:00100000:1.0:1788197533.009636:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776295424 00000100:00100000:1.0:1788197533.009642:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776295424 00010000:00010000:0.0:1788197533.009644:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240300d9 expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.009664:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240300cb expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.010979:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788197533.011010:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+20:3314:x1875060776295296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788197533.011027:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197533.011035:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240300d9 expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.011047:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c29240300d9 expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.011065:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030400/0x167e6c29240300e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c29240300d9 expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.011082:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197533.011162:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776295296:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197533.011241:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788197533.011263:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788197533.011274:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3314:x1875060776295424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197533.011284:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197533.011290:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240300cb expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.011300:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c29240300cb expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.011304:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776295296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197533.011316:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7000/0x167e6c29240300d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c29240300cb expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.011327:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197533.011373:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3314:x1875060776295424:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197533.011380:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788197533.011449:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776295424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788197533.011717:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197533.011732:0:8525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788197533.011741:0:8525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:11681:x1875060776294656:12345-0@lo:104: 00010000:00010000:3.0:1788197533.011752:0:8525:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.011808:0:8525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788197533.011813:0:8525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+4:11681:x1875060776294656:12345-0@lo:104: Request processed in 75us (19826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197533.011842:0:8525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788197533.011857:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197533.011862:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.011887:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197533.011904:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.011912:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197533.011917:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197533.011922:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788197533.011948:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.011953:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197533.011970:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.011977:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700030e00/0x167e6c29240300e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240300ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.011990:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197533.011992:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197533.011994:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197533.012005:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776295552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788197533.012036:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197533.012075:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776295552 00000100:00100000:3.0:1788197533.012080:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776295552 00010000:00010000:3.0:1788197533.012118:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240300e7 expref: 17 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197533.012146:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788197533.012153:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7066c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3311:x1875060776295552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788197533.012161:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197533.012166:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240300e7 expref: 17 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.012175:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c29240300e7 expref: 17 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197533.012185:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197533.012211:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7066c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3311:x1875060776295552:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197533.012217:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788197533.012259:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776295552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197533.012543:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701387a00/0x167e6c29240300ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c29240300e7 expref: 16 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197533.012555:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c707c01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776294656:0@lo:104: 00000100:00100000:3.0:1788197533.015504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197533.015770:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289472 00000100:00100000:0.0:1788197533.015779:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289472 00010000:00010000:0.0:1788197533.015813:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 13 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.015888:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:0.0:1788197533.015908:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755289472:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197533.015921:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197533.015927:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 13 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.015938:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 13 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.015957:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197533.016010:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755289472:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 105us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197533.016018:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00010000:00010000:1.0:1788197533.016598:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030200/0x167e6c29240300c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56eb expref: 12 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197533.016614:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776295040:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197533.016642:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875060776295168:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197533.016673:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197533.017968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197533.018045:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289600 00000100:00100000:0.0:1788197533.018052:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289600 00010000:00010000:0.0:1788197533.018081:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.018133:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:0.0:1788197533.018143:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+12:2358:x1875060755289600:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197533.018156:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197533.018162:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018174:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018207:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c74155dc00/0x167e6c29240300bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56e4 expref: 12 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018222:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018230:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018244:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018250:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018256:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018264:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018269:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc17bc230) 00000100:00100000:2.0:1788197533.018271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788197533.018275:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018284:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018306:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197533.018326:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197533.018358:0:11681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.018369:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197533.018380:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700030c00/0x167e6c2924030222 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197533.018381:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+11:2358:x1875060755289600:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 234us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197533.018397:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00010000:00010000:3.0:1788197533.297666:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197533.550717:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776295680:0@lo:400:kworker.0 00000100:00100000:3.0:1788197533.550781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197533.550878:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788197533.550916:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197533.550944:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197533.550949:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776296064:0@lo:400:kworker.0 00000100:00100000:3.0:1788197533.550970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197533.551071:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776295808:0@lo:400:kworker.0 00000100:00100000:0.0:1788197533.551114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197533.551142:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197533.551147:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776295936:0@lo:400:kworker.0 00000100:00100000:0.0:1788197533.551170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197533.551189:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296192 00000100:00100000:2.0:1788197533.551196:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296192 00000100:00100000:0.0:1788197533.551211:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776295936 00000100:00100000:0.0:1788197533.551214:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776295936 00000100:00100000:0.0:1788197533.551253:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788197533.551263:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776295936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197533.551310:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776295936:12345-0@lo:400:kworker.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197533.551316:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788197533.551362:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776295680 00000100:00100000:1.0:1788197533.551366:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776295680 00000100:00100000:1.0:1788197533.551392:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296064 00000100:00100000:1.0:1788197533.551395:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296064 00000100:00100000:1.0:1788197533.551406:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776295808 00000100:00100000:1.0:1788197533.551408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776295808 00000100:00100000:1.0:1788197533.551420:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788197533.551426:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776295680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197533.551496:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776295680:12345-0@lo:400:kworker.0 Request processed in 70us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197533.551502:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788197533.551515:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788197533.551521:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776296064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197533.551547:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776296064:12345-0@lo:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197533.551552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788197533.551576:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788197533.551581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776295808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197533.551608:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776295808:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197533.551613:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788197533.551648:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788197533.551658:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776295680:0@lo:400:kworker.0 00000100:00100000:1.0:1788197533.551771:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788197533.551781:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776295808:0@lo:400:kworker.0 00000100:00080000:3.0:1788197533.551964:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788197533.551974:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788197533.560752:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788197533.560775:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776296192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197533.560917:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776296192:12345-0@lo:400:kworker.0 Request processed in 153us (9999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197533.560924:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788197533.563523:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c740ff8000 x1875060776296192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197533.563540:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776296192:0@lo:400:kworker.0 00000100:00100000:2.0:1788197534.062155:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788197534.062178:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197534.062255:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.062386:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296320 00000100:00100000:0.0:1788197534.062394:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296320 00000100:00100000:0.0:1788197534.062446:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788197534.062456:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776296320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197534.062488:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197534.062542:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776296320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.062550:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788197534.062671:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736aca300 x1875060776296320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197534.062689:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776296320:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788197534.126128:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788197534.126136:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c736929000 from 7 10000000:01000000:2.0:1788197534.126141:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788197534.126216:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.126228:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.126239:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197534.126270:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776296448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788197534.126331:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197534.126525:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707d65e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788197534.126530:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296448 00000100:00100000:3.0:1788197534.126538:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296448 00000100:00100000:3.0:1788197534.126596:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788197534.126605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:5839:x1875060776296448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197534.126617:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197534.126630:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7a00/0x167e6c2924030230 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924030229 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197534.126652:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7a00/0x167e6c2924030230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924030229 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197534.126662:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7a00/0x167e6c2924030230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030229 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197534.126670:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7a00, rc 0) 00000100:00100000:3.0:1788197534.126721:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776296448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197534.126727:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788197534.126872:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776296448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197534.126895:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.126905:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197534.126960:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776296576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197534.126986:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197534.127014:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707d65e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788197534.127067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296576 00000100:00100000:3.0:1788197534.127071:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296576 00000100:00100000:3.0:1788197534.127174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788197534.127182:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776296576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197534.129088:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776296576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1898us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197534.129100:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788197534.129269:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776296576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197534.129317:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776296704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197534.129365:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197534.129406:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707d65e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197534.129809:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296704 00000100:00100000:1.0:1788197534.129816:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296704 00000100:00100000:1.0:1788197534.129892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788197534.129901:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776296704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788197534.130070:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776296704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197534.130078:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788197534.130258:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776296704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197534.130949:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11694:1875060776296832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197534.130997:0:11694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197534.131068:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707d65a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197534.131107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296832 00000100:00100000:1.0:1788197534.131113:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296832 00000100:00100000:1.0:1788197534.131251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788197534.131260:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:11694:x1875060776296832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197534.131479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:11694:x1875060776296832:12345-0@lo:502:llog_process_th.0 Request processed in 221us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197534.131493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788197534.131708:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11694:1875060776296832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788197534.131731:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197534.131744:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197534.131746:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788197534.131753:0:11694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c736929000 00000020:00000080:2.0:1788197534.131755:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788197534.131854:0:11694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11694:1875060776296960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197534.132639:0:11694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197534.132682:0:11694:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707d65a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197534.132746:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776296960 00000100:00100000:0.0:1788197534.132759:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776296960 00000100:00100000:0.0:1788197534.132801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788197534.132809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:11694:x1875060776296960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197534.133014:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:11694:x1875060776296960:12345-0@lo:502:llog_process_th.0 Request processed in 205us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.133021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788197534.134560:0:11694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11694:1875060776296960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788197534.134608:0:11694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197534.134616:0:11694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197534.134618:0:11694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788197534.134623:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788197534.134965:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788197534.134984:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197534.134993:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.135003:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197534.135013:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788197534.135015:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c70f634000 from 7 10000000:01000000:0.0:1788197534.135018:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197534.135047:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.135056:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.135065:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197534.135084:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.135133:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.135177:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197534.135281:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297088 00000100:00100000:2.0:1788197534.135288:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297088 00000100:00100000:2.0:1788197534.135327:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788197534.135335:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:5839:x1875060776297088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197534.135347:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197534.135359:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155c600/0x167e6c292403023e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924030237 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.135381:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155c600/0x167e6c292403023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924030237 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.135391:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155c600/0x167e6c292403023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030237 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.135399:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c600, rc 0) 00000100:00100000:2.0:1788197534.135435:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776297088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197534.135468:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788197534.135625:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197534.135644:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.135653:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197534.135698:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.135725:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.135747:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197534.135762:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297216 00000100:00100000:0.0:1788197534.135765:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297216 00000100:00100000:0.0:1788197534.135786:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788197534.135793:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776297216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.136047:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c703150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776297216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.136054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788197534.136083:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.136109:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.136157:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.136171:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197534.136182:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297344 00000100:00100000:0.0:1788197534.136185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297344 00000100:00100000:0.0:1788197534.136203:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788197534.136209:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776297344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.136332:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776297344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.136346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788197534.136381:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.140064:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11695:1875060776297472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197534.140268:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.140307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297472 00000100:00100000:0.0:1788197534.140316:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297472 00000100:00100000:1.0:1788197534.140326:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788197534.140349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788197534.140358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:11695:x1875060776297472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197534.140810:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:11695:x1875060776297472:12345-0@lo:502:llog_process_th.0 Request processed in 450us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.140818:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788197534.140995:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11695:1875060776297472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788197534.141024:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788197534.141034:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197534.141036:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788197534.141042:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c70f634000 00000020:00000080:1.0:1788197534.141045:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788197534.141262:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11695:1875060776297600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197534.141299:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197534.141326:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197534.141350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297600 00000100:00100000:1.0:1788197534.141354:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297600 00000100:00100000:1.0:1788197534.141380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788197534.141388:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:11695:x1875060776297600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197534.141537:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:11695:x1875060776297600:12345-0@lo:502:llog_process_th.0 Request processed in 150us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197534.141545:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788197534.141590:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11695:1875060776297600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788197534.141772:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788197534.141777:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197534.141779:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788197534.141782:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788197534.141975:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788197534.141996:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788197534.142005:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.142015:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197534.142025:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788197534.142028:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c706bce800 from 7 10000000:01000000:0.0:1788197534.142030:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197534.142054:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.142062:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.142083:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197534.142096:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.142126:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.142163:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788197534.142404:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297728 00000100:00100000:1.0:1788197534.142409:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297728 00000100:00100000:1.0:1788197534.142452:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788197534.142462:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:5839:x1875060776297728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788197534.142479:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197534.142492:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c701387a00/0x167e6c292403024c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924030245 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197534.142516:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c701387a00/0x167e6c292403024c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924030245 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197534.142526:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c701387a00/0x167e6c292403024c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924030245 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197534.142535:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387a00, rc 0) 00000100:00100000:1.0:1788197534.142563:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776297728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197534.142756:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788197534.142856:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197534.142869:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.142878:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197534.143310:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.143341:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.145305:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788197534.150779:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297856 00000100:00100000:1.0:1788197534.150795:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297856 00000100:00100000:1.0:1788197534.150865:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788197534.150876:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776297856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197534.151189:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776297856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (7846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197534.151198:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788197534.152879:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.152953:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.154549:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.154594:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7414b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788197534.154656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776297984 00000100:00100000:1.0:1788197534.154664:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776297984 00000100:00100000:1.0:1788197534.154713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788197534.154722:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776297984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788197534.154963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:5839:x1875060776297984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197534.154979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000040:00080000:3.0:1788197534.155817:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788197534.155982:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3d1c03da-de40-4aeb-8e95-9670c13aad9c:5839:1875060776297984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197534.158590:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11699:1875060776298112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197534.158660:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197534.158698:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707d65180 going to sleep for 11 seconds 00000100:00100000:1.0:1788197534.158766:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776298112 00000100:00100000:1.0:1788197534.158773:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776298112 00000100:00100000:1.0:1788197534.159269:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788197534.159280:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:11699:x1875060776298112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197534.159527:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:11699:x1875060776298112:12345-0@lo:502:llog_process_th.0 Request processed in 247us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197534.159535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788197534.159614:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11699:1875060776298112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788197534.159650:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197534.159659:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197534.159661:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788197534.159671:0:11699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c706bce800 00000020:00000080:3.0:1788197534.159673:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788197534.159745:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11699:1875060776298240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788197534.159783:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197534.160368:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197534.160528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776298240 00000100:00100000:2.0:1788197534.160535:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776298240 00000100:00100000:2.0:1788197534.160567:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788197534.160574:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:11699:x1875060776298240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197534.160778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:11699:x1875060776298240:12345-0@lo:502:llog_process_th.0 Request processed in 203us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197534.160785:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788197534.161123:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3d1c03da-de40-4aeb-8e95-9670c13aad9c:11699:1875060776298240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788197534.161149:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197534.161155:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197534.161156:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788197534.161163:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788197534.161219:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788197534.161235:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788197534.161244:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197534.161255:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197534.323642:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197534.576683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197534.576919:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289728 00000100:00100000:2.0:1788197534.576928:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289728 00000100:00100000:2.0:1788197534.576982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 266 00000100:00100000:2.0:1788197534.576993:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+11:5600:x1875060755289728:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197534.577010:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197534.577026:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155de00/0x167e6c2924030253 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5738 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.577052:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155de00/0x167e6c2924030253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5738 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.577062:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155de00/0x167e6c2924030253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5738 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197534.577070:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155de00, rc 0) 00000100:00100000:2.0:1788197534.577136:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755289728:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 144us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197534.577144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 266 00000100:00100000:1.0:1788197534.577863:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776298368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197534.577917:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197534.578022:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776298368 00000100:00100000:0.0:1788197534.578028:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776298368 00000100:00100000:0.0:1788197534.578074:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788197534.578081:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875060776298368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197534.578105:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197534.578146:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875060776298368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.578153:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788197534.578215:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788197534.579514:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776298368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197534.580879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197534.580968:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289856 00000100:00100000:0.0:1788197534.580976:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289856 00000100:00100000:0.0:1788197534.581029:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 267 00000100:00100000:0.0:1788197534.581037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755289856:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.581346:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755289856:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 308us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.581354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 267 00000100:00100000:3.0:1788197534.583341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197534.583612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755289984 00000100:00100000:0.0:1788197534.583621:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755289984 00000100:00100000:0.0:1788197534.583734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 268 00000100:00100000:0.0:1788197534.583744:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755289984:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.584369:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755289984:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 625us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.584378:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 268 00000100:00100000:1.0:1788197534.587528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197534.588168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755290112 00000100:00100000:2.0:1788197534.588178:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755290112 00000100:00100000:2.0:1788197534.588228:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 269 00000100:00100000:2.0:1788197534.588237:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+12:9967:x1875060755290112:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788197534.588479:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+12:9967:x1875060755290112:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 243us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197534.588487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 269 00000100:00100000:2.0:1788197534.596011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197534.599555:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755290240 00000100:00100000:0.0:1788197534.599570:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755290240 00000100:00100000:0.0:1788197534.599716:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 270 00000100:00100000:0.0:1788197534.599727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+12:9967:x1875060755290240:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197534.600009:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+12:9967:x1875060755290240:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 283us (4006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.600029:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 270 00000100:00100000:3.0:1788197534.605083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197534.605478:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755290368 00000100:00100000:0.0:1788197534.605487:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755290368 00000100:00100000:0.0:1788197534.605539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 271 00000100:00100000:0.0:1788197534.605548:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+12:5600:x1875060755290368:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197534.605563:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197534.605578:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700031600/0x167e6c292403025a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d573f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.605605:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700031600/0x167e6c292403025a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d573f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.605616:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700031600/0x167e6c292403025a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d573f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197534.605625:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031600, rc 0) 00000100:00100000:0.0:1788197534.605723:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755290368:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 176us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.605730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 271 00000100:00100000:1.0:1788197534.617505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197534.617672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755290496 00000100:00100000:0.0:1788197534.617682:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755290496 00000100:00100000:0.0:1788197534.617778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 272 00000100:00100000:0.0:1788197534.617789:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755290496:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197534.618114:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755290496:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 325us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.618123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 272 00000100:00100000:3.0:1788197534.620627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197534.620801:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755290624 00000100:00100000:2.0:1788197534.620811:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755290624 00000100:00100000:2.0:1788197534.620906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 273 00000100:00100000:2.0:1788197534.620919:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755290624:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197534.621151:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70661b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:5600:x1875060755290624:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 234us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197534.621158:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 273 00000100:00100000:3.0:1788197534.635137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197534.635588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755290752 00000100:00100000:0.0:1788197534.635599:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755290752 00000100:00100000:0.0:1788197534.635659:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 274 00000100:00100000:0.0:1788197534.635678:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:9970:x1875060755290752:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197534.635982:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:9970:x1875060755290752:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 305us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.635991:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 274 00000100:00100000:1.0:1788197534.643516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197534.643845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755290880 00000100:00100000:0.0:1788197534.643855:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755290880 00000100:00100000:0.0:1788197534.643929:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 275 00000100:00100000:0.0:1788197534.643940:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:9970:x1875060755290880:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197534.644414:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:9970:x1875060755290880:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 474us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197534.644423:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 275 00000040:00080000:2.0:1788197535.216006:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788197535.342081:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197536.366382:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197536.879585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197536.879690:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291008 00000100:00100000:2.0:1788197536.879700:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291008 00000100:00100000:2.0:1788197536.879770:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 276 00000100:00100000:2.0:1788197536.879781:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755291008:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197536.881925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755291008:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 2134us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197536.881940:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 276 00000100:00100000:3.0:1788197536.886424:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197536.886473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197536.886510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197536.886607:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291264 00000100:00100000:0.0:1788197536.886626:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291264 00000100:00100000:0.0:1788197536.886697:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:0.0:1788197536.886707:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755291264:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197536.886768:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755291264:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 62us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197536.886776:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00080000:3.0:1788197536.886977:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197536.887381:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291136 00000100:00100000:1.0:1788197536.887386:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291136 00000100:00100000:1.0:1788197536.887429:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291392 00000100:00100000:1.0:1788197536.887432:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291392 00000100:00100000:1.0:1788197536.887457:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:1.0:1788197536.887464:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755291136:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197536.887505:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755291136:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 41us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197536.887512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:1.0:1788197536.887526:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 111 00000100:00100000:1.0:1788197536.887533:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2358:x1875060755291392:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197536.887555:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2358:x1875060755291392:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197536.887574:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 111 00000100:00080000:3.0:1788197536.887864:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788197537.390121:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788197537.725317:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1788197538.414035:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197538.670338:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776298880:0@lo:400:kworker.0 00000100:00100000:1.0:1788197538.670421:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197538.670661:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788197538.670669:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776298752:0@lo:400:kworker.0 00000100:00100000:1.0:1788197538.670699:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197538.670732:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776298752 00000100:00100000:1.0:1788197538.670738:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776298752 00000100:00100000:1.0:1788197538.670786:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788197538.670794:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776298752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.670979:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776298496:0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.671025:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197538.671050:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776299008:0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.671074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197538.671093:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788197538.671098:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776298624:0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.671118:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197538.671136:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776299136:0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.671156:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197538.671192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299008 00000100:00100000:2.0:1788197538.671196:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299008 00000100:00100000:2.0:1788197538.671219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776298624 00000100:00100000:2.0:1788197538.671222:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776298624 00000100:00100000:2.0:1788197538.671237:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788197538.671243:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776299008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.671281:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776299008:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197538.671288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788197538.671304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788197538.671311:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776298624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.671336:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776298624:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197538.671357:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788197538.671392:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776298624:0@lo:400:kworker.0 00000100:00100000:2.0:1788197538.671402:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776299008:0@lo:400:kworker.0 00000100:00100000:0.0:1788197538.672087:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776298496 00000100:00100000:0.0:1788197538.672096:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776298496 00000100:00100000:0.0:1788197538.672133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788197538.672142:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776298496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197538.672315:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776298496:12345-0@lo:400:kworker.0 Request processed in 173us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197538.672331:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788197538.672363:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776298880 00000100:00100000:0.0:1788197538.672367:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776298880 00000100:00100000:0.0:1788197538.672394:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299136 00000100:00100000:0.0:1788197538.672397:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299136 00000100:00100000:0.0:1788197538.672416:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788197538.672423:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776298880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197538.672543:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788197538.672553:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776299136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197538.672589:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776299136:12345-0@lo:400:kworker.0 Request processed in 39us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197538.672595:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788197538.672613:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788197538.672616:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788197538.672618:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788197538.672679:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c740ff9180 x1875060776299136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197538.672691:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776299136:0@lo:400:kworker.0 00000100:00100000:3.0:1788197538.672700:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776298496:0@lo:400:kworker.0 00000100:00100000:0.0:1788197538.673401:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776298880:12345-0@lo:400:kworker.0 Request processed in 975us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197538.673409:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788197538.675166:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788197538.675176:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c736ac8e00, transno 4294967300 00000100:00100000:2.0:1788197538.675202:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776298880:0@lo:400:kworker.0 00000100:00100000:1.0:1788197538.675705:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776298752:12345-0@lo:400:kworker.0 Request processed in 4908us (5002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197538.675717:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788197538.676086:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776298752:0@lo:400:kworker.0 00000100:00100000:0.0:1788197539.182078:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776299264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197539.182146:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197539.182347:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299264 00000100:00100000:3.0:1788197539.182355:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299264 00000100:00100000:3.0:1788197539.182403:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788197539.182412:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776299264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197539.182449:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197539.182505:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776299264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197539.182528:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788197539.182667:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c736ac8e00 x1875060776299264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197539.182686:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776299264:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197539.438098:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197539.694310:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776299392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197539.694384:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197539.694558:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299392 00000100:00100000:3.0:1788197539.694566:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299392 00000100:00100000:3.0:1788197539.694619:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788197539.694629:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776299392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197539.694661:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197539.694715:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776299392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197539.694721:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788197539.694809:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776299392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197540.467153:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197541.488121:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197541.998735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197541.998777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197541.998861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197541.998907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197541.998939:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291776 00000100:00100000:3.0:1788197541.998951:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291776 00000100:00100000:3.0:1788197541.999034:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:3.0:1788197541.999046:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755291776:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197541.999127:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755291776:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197541.999137:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00080000:3.0:1788197541.999253:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197541.999657:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291648 00000100:00100000:0.0:1788197541.999663:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291648 00000100:00100000:0.0:1788197541.999708:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291904 00000100:00100000:0.0:1788197541.999711:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291904 00000100:00100000:0.0:1788197541.999735:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:0.0:1788197541.999743:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755291648:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197541.999797:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755291648:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 55us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197541.999804:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:0.0:1788197541.999873:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:0.0:1788197541.999879:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755291904:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197541.999906:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755291904:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197541.999912:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:2.0:1788197542.001356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755291520 00000100:00100000:2.0:1788197542.001368:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755291520 00000100:00100000:2.0:1788197542.001432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 278 00000100:00100000:2.0:1788197542.001442:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755291520:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197542.001500:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755291520:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 60us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197542.001507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 278 00000100:00080000:3.0:1788197542.001856:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788197542.510213:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197543.534038:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197543.790290:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776299904:0@lo:400:kworker.0 00000100:00100000:1.0:1788197543.790330:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776299648:0@lo:400:kworker.0 00000100:00100000:1.0:1788197543.790391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197543.790424:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776299520:0@lo:400:kworker.0 00000100:00100000:1.0:1788197543.790451:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776300160:0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.790466:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197543.790495:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776300032:0@lo:400:kworker.0 00000100:00100000:1.0:1788197543.790498:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197543.790539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197543.790568:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776299776:0@lo:400:kworker.0 00000100:00100000:1.0:1788197543.790569:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300160 00000100:00100000:1.0:1788197543.790590:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300160 00000100:00100000:3.0:1788197543.790591:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299648 00000100:00100000:3.0:1788197543.790598:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299648 00000100:00100000:0.0:1788197543.790609:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197543.790649:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300032 00000100:00100000:3.0:1788197543.790650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299776 00000100:00100000:1.0:1788197543.790650:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788197543.790653:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300032 00000100:00100000:3.0:1788197543.790656:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299776 00000100:00100000:1.0:1788197543.790662:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776300160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197543.790681:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788197543.790690:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788197543.790691:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776299648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.790703:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776300032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197543.790713:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776300160:12345-0@lo:400:kworker.0 Request processed in 55us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197543.790724:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776299648:12345-0@lo:400:kworker.0 Request processed in 37us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197543.790735:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788197543.790753:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776300032:12345-0@lo:400:kworker.0 Request processed in 53us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197543.790762:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299520 00000100:00100000:1.0:1788197543.790767:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299520 00000100:00100000:1.0:1788197543.790807:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788197543.790807:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788197543.790814:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776299520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197543.790876:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776299520:12345-0@lo:400:kworker.0 Request processed in 62us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197543.790928:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197543.790972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:1.0:1788197543.790998:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788197543.791003:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197543.791027:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776299648:0@lo:400:kworker.0 00010000:00080000:1.0:1788197543.791040:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414ab480 x1875060776300160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197543.791048:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776300160:0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.793608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788197543.793654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788197543.793669:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.793773:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776299776:12345-0@lo:400:kworker.0 Request processed in 111us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197543.793780:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788197543.793814:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776299904 00000100:00100000:3.0:1788197543.793847:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776299904 00000100:00100000:3.0:1788197543.793903:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788197543.793910:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776299904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.793950:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776299904:12345-0@lo:400:kworker.0 Request processed in 40us (3021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197543.793955:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788197543.794258:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197543.794313:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776299776:0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.794386:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776299520:0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.794399:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776300032:0@lo:400:kworker.0 00000100:00100000:3.0:1788197543.794435:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776299904:0@lo:400:kworker.0 00000100:00100000:3.0:1788197544.302351:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788197544.302371:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776300288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197544.302429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197544.302497:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300288 00000100:00100000:3.0:1788197544.302503:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300288 00000100:00100000:3.0:1788197544.302545:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788197544.302554:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776300288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197544.302586:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197544.302640:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776300288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197544.302647:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788197544.302691:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c73c2e2300 x1875060776300288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197544.302709:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776300288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197544.561725:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197544.820181:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197544.820203:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776300416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197544.820273:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197544.821101:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300416 00000100:00100000:3.0:1788197544.821112:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300416 00000100:00100000:3.0:1788197544.821166:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788197544.821176:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776300416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197544.821212:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197544.821275:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776300416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197544.821294:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788197544.821553:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776300416:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788197545.454477:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788197545.583043:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197546.610048:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197547.120341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197547.120394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197547.120434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197547.120502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197547.120538:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292288 00000100:00100000:3.0:1788197547.120548:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292288 00000100:00100000:3.0:1788197547.120628:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:3.0:1788197547.120639:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755292288:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197547.120721:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755292288:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 85us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197547.120733:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00080000:3.0:1788197547.120885:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197547.121152:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292160 00000100:00100000:0.0:1788197547.121157:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292160 00000100:00100000:0.0:1788197547.121194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292416 00000100:00100000:0.0:1788197547.121198:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292416 00000100:00100000:0.0:1788197547.121219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:0.0:1788197547.121226:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755292160:12345-192.168.206.40@tcp:400:kworker.0 00000100:00080000:3.0:1788197547.121237:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197547.121273:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755292160:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 47us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197547.121280:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:0.0:1788197547.121304:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:0.0:1788197547.121309:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755292416:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197547.121337:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755292416:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197547.121343:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:1.0:1788197547.123655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292032 00000100:00100000:1.0:1788197547.123668:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292032 00000100:00100000:1.0:1788197547.123741:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 280 00000100:00100000:1.0:1788197547.123751:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755292032:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197547.123865:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755292032:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 115us (3430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197547.123873:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 280 00010000:00010000:3.0:1788197547.630145:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197548.654024:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197548.910224:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776300928:0@lo:400:kworker.0 00000100:00100000:0.0:1788197548.910392:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776300800:0@lo:400:kworker.0 00000100:00100000:0.0:1788197548.910424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197548.910503:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300800 00000100:00100000:0.0:1788197548.910509:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300800 00000100:00100000:0.0:1788197548.910565:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788197548.910574:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776300800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197548.910638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776300800:12345-0@lo:400:kworker.0 Request processed in 65us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197548.910645:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1788197548.910667:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197548.910694:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776300800:0@lo:400:kworker.0 00000100:00100000:1.0:1788197548.910869:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776300672:0@lo:400:kworker.0 00000100:00100000:1.0:1788197548.910902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197548.910947:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776301184:0@lo:400:kworker.0 00000100:00100000:3.0:1788197548.911235:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776300544:0@lo:400:kworker.0 00000100:00100000:3.0:1788197548.911270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197548.911315:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776301056:0@lo:400:kworker.0 00000100:00100000:3.0:1788197548.911338:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197548.911380:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300672 00000100:00100000:3.0:1788197548.911385:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300672 00000100:00100000:3.0:1788197548.911410:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301056 00000100:00100000:3.0:1788197548.911414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301056 00000100:00100000:3.0:1788197548.911436:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788197548.911451:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776300672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197548.911491:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776300672:12345-0@lo:400:kworker.0 Request processed in 41us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197548.911498:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788197548.911511:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788197548.911518:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776301056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197548.911549:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776301056:12345-0@lo:400:kworker.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197548.911555:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788197548.911582:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776301056:0@lo:400:kworker.0 00000100:00100000:2.0:1788197548.911792:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197548.911966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300544 00000100:00100000:1.0:1788197548.911971:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300544 00000100:00100000:1.0:1788197548.912001:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788197548.912008:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776300544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197548.912049:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776300544:12345-0@lo:400:kworker.0 Request processed in 41us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197548.912056:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788197548.912085:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197548.912116:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776300672:0@lo:400:kworker.0 00000100:00100000:1.0:1788197548.912145:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776300544:0@lo:400:kworker.0 00000100:00100000:0.0:1788197548.912425:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776300928 00000100:00100000:0.0:1788197548.912430:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776300928 00000100:00100000:0.0:1788197548.912472:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301184 00000100:00100000:0.0:1788197548.912476:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301184 00000100:00100000:0.0:1788197548.912506:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788197548.912514:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776300928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197548.912557:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776300928:12345-0@lo:400:kworker.0 Request processed in 44us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197548.912563:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788197548.912578:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788197548.912605:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776301184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197548.912638:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776301184:12345-0@lo:400:kworker.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197548.912644:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788197548.912665:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197548.912668:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197548.912670:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197548.912696:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776300928:0@lo:400:kworker.0 00010000:00080000:1.0:1788197548.913794:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7414a9c00 x1875060776301184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197548.913816:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776301184:0@lo:400:kworker.0 00000100:00100000:0.0:1788197549.422243:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776301312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197549.422314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197549.422437:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301312 00000100:00100000:3.0:1788197549.422444:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301312 00000100:00100000:3.0:1788197549.422495:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788197549.422505:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776301312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197549.422537:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197549.422697:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776301312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197549.422705:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788197549.422847:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7368ad500 x1875060776301312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197549.422865:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776301312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197549.678103:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197549.938332:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197549.938357:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776301440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197549.938426:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197549.938786:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301440 00000100:00100000:3.0:1788197549.938794:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301440 00000100:00100000:3.0:1788197549.938882:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788197549.938891:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776301440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197549.938923:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197549.938978:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776301440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197549.939001:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788197549.939094:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776301440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197550.702212:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197551.726615:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197552.239798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197552.239875:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292544 00000100:00100000:1.0:1788197552.239886:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292544 00000100:00100000:3.0:1788197552.239892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197552.239945:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 282 00000100:00100000:2.0:1788197552.239993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292672 00000100:00100000:2.0:1788197552.239998:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292672 00000100:00100000:2.0:1788197552.240052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00080000:0.0:1788197552.240099:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197552.240139:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755292672:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197552.240213:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755292672:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 78us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197552.240235:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755292544:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197552.240269:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755292544:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 315us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197552.240275:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 282 00000100:00100000:2.0:1788197552.241042:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:3.0:1788197552.258141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197552.258235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197552.258439:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292928 00000100:00100000:1.0:1788197552.258448:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292928 00000100:00100000:1.0:1788197552.258529:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:1.0:1788197552.258540:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755292928:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197552.258626:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755292928:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 88us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197552.258633:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00080000:2.0:1788197552.259069:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197552.263459:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755292800 00000100:00100000:0.0:1788197552.263474:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755292800 00000100:00100000:0.0:1788197552.263564:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00080000:2.0:1788197552.263709:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197552.263820:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2356:x1875060755292800:12345-192.168.206.40@tcp:9:kworker.0 00000020:00000080:0.0:1788197552.263876:0:8021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c2924030196 00000100:00080000:0.0:1788197552.263886:0:8021:0:(import.c:65:import_set_state_nolock()) ffff93c740fe9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788197552.263947:0:8021:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788197552.264222:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+2:2356:x1875060755292800:12345-192.168.206.40@tcp:9:kworker.0 Request processed in 399us (6083us total) trans 0 rc 0/0 00010000:00010000:3.0:1788197552.264986:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197552.265369:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00010000:00010000:3.0:1788197552.751756:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788197553.079983:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:3.0:1788197553.079993:0:6721:0:(genops.c:885:class_export_put()) final put ffff93c706742800/87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:2.0:1788197553.080062:0:474:0:(genops.c:844:class_export_destroy()) destroying export ffff93c706742800/87c79f47-cb13-4c8a-942c-8f23eb455b39 for lustre-OST0000 00000020:00000080:2.0:1788197553.080114:0:474:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c740fe9800 for lustre-OST0000 00010000:00010000:3.0:1788197553.781806:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197554.031052:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776301696:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197554.031179:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776302208:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197554.031234:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788197554.031239:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776301568:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031265:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197554.031280:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776302080:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031299:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197554.031326:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776301952:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031347:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197554.031362:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788197554.031367:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776301824:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031386:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197554.031431:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301696 00000100:00100000:3.0:1788197554.031439:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301696 00000100:00100000:3.0:1788197554.031480:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302080 00000100:00100000:3.0:1788197554.031484:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302080 00000100:00100000:3.0:1788197554.031502:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301824 00000100:00100000:3.0:1788197554.031504:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301824 00000100:00100000:3.0:1788197554.031519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788197554.031528:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776301696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031578:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776301696:12345-0@lo:400:kworker.0 Request processed in 50us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197554.031585:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788197554.031600:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788197554.031606:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776302080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031634:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776302080:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197554.031639:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788197554.031650:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788197554.031655:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776301824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031685:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776301824:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197554.031691:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788197554.031709:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302208 00000100:00100000:3.0:1788197554.031712:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302208 00000100:00100000:3.0:1788197554.031736:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301952 00000100:00100000:3.0:1788197554.031739:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301952 00000100:00100000:3.0:1788197554.031758:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788197554.031764:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776302208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031808:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776302208:12345-0@lo:400:kworker.0 Request processed in 43us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197554.031849:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788197554.031862:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788197554.031868:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776301952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031900:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776301952:12345-0@lo:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197554.031905:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788197554.031951:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776301824:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031962:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776301952:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.031995:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776302080:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.032005:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776301696:0@lo:400:kworker.0 00010000:00080000:3.0:1788197554.032016:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7368ac000 x1875060776302208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197554.032025:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776302208:0@lo:400:kworker.0 00000100:00100000:2.0:1788197554.032124:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776301568 00000100:00100000:2.0:1788197554.032129:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776301568 00000100:00100000:2.0:1788197554.032162:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788197554.032169:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776301568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197554.032212:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776301568:12345-0@lo:400:kworker.0 Request processed in 43us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197554.032218:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:2.0:1788197554.032249:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197554.032254:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197554.032256:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197554.032272:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776301568:0@lo:400:kworker.0 00000100:00100000:3.0:1788197554.548237:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788197554.548262:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776302336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197554.548328:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197554.548407:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302336 00000100:00100000:3.0:1788197554.548415:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302336 00000100:00100000:3.0:1788197554.548476:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788197554.548485:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776302336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197554.548525:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197554.548592:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776302336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197554.548615:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788197554.548658:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7368ac000 x1875060776302336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197554.548676:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776302336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197554.802996:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197555.056201:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776302464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197555.056280:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197555.056359:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302464 00000100:00100000:2.0:1788197555.056366:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302464 00000100:00100000:2.0:1788197555.056413:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788197555.056423:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776302464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788197555.056456:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197555.056519:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776302464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197555.056527:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788197555.056595:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776302464:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788197555.694452:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788197555.822995:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197556.847154:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197557.360066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197557.360109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197557.360145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197557.360219:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755293056 00000100:00100000:1.0:1788197557.360229:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755293056 00000100:00100000:1.0:1788197557.360289:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 284 00000100:00100000:2.0:1788197557.360292:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755293312 00000100:00100000:2.0:1788197557.360299:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755293312 00000100:00100000:1.0:1788197557.360302:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755293056:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197557.360343:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755293184 00000100:00100000:2.0:1788197557.360347:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755293184 00000100:00100000:1.0:1788197557.360371:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755293056:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 72us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197557.360375:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:1.0:1788197557.360385:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 284 00000100:00100000:2.0:1788197557.360390:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755293312:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197557.360430:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755293312:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197557.360437:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:2.0:1788197557.360450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 131 00000100:00100000:2.0:1788197557.360458:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755293184:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197557.360487:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755293184:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197557.360494:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 131 00000100:00080000:2.0:1788197557.360514:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788197557.578174:0:11867:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:32:35 (1788197555) 00010000:00010000:3.0:1788197557.875639:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197558.894338:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197559.150071:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197559.150390:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197559.150411:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776302720:0@lo:400:kworker.0 00000100:00100000:2.0:1788197559.150480:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197559.152188:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302720 00000100:00100000:1.0:1788197559.152203:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302720 00000100:00100000:1.0:1788197559.152280:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788197559.152290:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776302720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197559.152309:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776302592:0@lo:400:kworker.0 00000100:00100000:3.0:1788197559.152596:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197559.153040:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776302848:0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.153110:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776302720:12345-0@lo:400:kworker.0 Request processed in 821us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.153118:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788197559.153159:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776303104:0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.153205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197559.153257:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776302720:0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.153275:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197559.153280:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776303232:0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.153307:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197559.153339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776303104 00000100:00100000:1.0:1788197559.153346:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776303104 00000100:00100000:1.0:1788197559.153390:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788197559.153400:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776303104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.153438:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776303104:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.153445:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1788197559.153461:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197559.153480:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776303104:0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.153504:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776302976:0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.153530:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197559.153561:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776303232 00000100:00100000:1.0:1788197559.153565:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776303232 00000100:00100000:1.0:1788197559.153592:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302976 00000100:00100000:1.0:1788197559.153594:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302976 00000100:00100000:1.0:1788197559.153614:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788197559.154096:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776303232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.154142:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776303232:12345-0@lo:400:kworker.0 Request processed in 522us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.154150:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788197559.154166:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788197559.154182:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776302976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.154217:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776302976:12345-0@lo:400:kworker.0 Request processed in 36us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.154223:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788197559.154250:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788197559.154253:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197559.154273:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776302976:0@lo:400:kworker.0 00010000:00080000:1.0:1788197559.154303:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c706b3f800 x1875060776303232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788197575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197559.154314:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776303232:0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.154356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302592 00000100:00100000:1.0:1788197559.154360:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302592 00000100:00100000:1.0:1788197559.154385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788197559.154392:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776302592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.154423:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776302592:12345-0@lo:400:kworker.0 Request processed in 31us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.154429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788197559.156152:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776302592:0@lo:400:kworker.0 00000100:00100000:0.0:1788197559.156152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197559.156316:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776302848 00000100:00100000:1.0:1788197559.156323:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776302848 00000100:00100000:1.0:1788197559.156438:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788197559.156448:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776302848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197559.156506:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776302848:12345-0@lo:400:kworker.0 Request processed in 59us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.156513:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788197559.156583:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776302848:0@lo:400:kworker.0 00000100:00080000:2.0:1788197559.157226:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197559.413423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197559.413653:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755293440 00000100:00100000:1.0:1788197559.413665:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755293440 00000100:00100000:1.0:1788197559.413784:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:1.0:1788197559.413795:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:10239:x1875060755293440:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197559.413815:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197559.413893:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5746 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.413974:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030268 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.413989:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.414004:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197559.414050:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788197559.414054:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197559.414098:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030268 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.414128:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5746 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.414151:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030268 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5746 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.414161:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46a00) 00010000:00010000:1.0:1788197559.414164:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788197559.414168:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387e00, rc 0) 00000100:00100000:1.0:1788197559.414227:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:10239:x1875060755293440:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 434us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.414504:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00080000:1.0:1788197559.415015:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197559.425444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197559.425661:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755293568 00000100:00100000:1.0:1788197559.425671:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755293568 00000100:00100000:1.0:1788197559.425734:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:1.0:1788197559.425752:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:10240:x1875060755293568:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197559.425774:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197559.425794:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c292403026f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d574d expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.425900:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.425914:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.425926:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.425941:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.425949:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426077:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426405:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c2924030284 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426428:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c2924030284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426437:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c2924030284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197559.426465:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788197559.426470:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197559.426490:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c2924030284 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426502:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426509:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426516:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426523:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197559.426788:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426799:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.426813:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46a00) 00010000:00010000:1.0:1788197559.426816:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197559.426845:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427056:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c2924030276 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427072:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427079:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427085:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427090:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197559.427094:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427100:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427109:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93c704a46700) 00010000:00010000:1.0:1788197559.427113:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197559.427115:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427122:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c292403027d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427160:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c292403026f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d574d expref: 8 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427177:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c2924030284 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d574d expref: 7 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.427192:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c704a46400) 00010000:00010000:1.0:1788197559.427195:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788197559.427198:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7420c2a00, rc 0) 00000100:00100000:1.0:1788197559.428083:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:10240:x1875060755293568:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 2334us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.428093:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:3.0:1788197559.435362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197559.443704:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755293824 00000100:00100000:1.0:1788197559.443732:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755293824 00000100:00100000:1.0:1788197559.443852:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:1.0:1788197559.443872:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:10240:x1875060755293824:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197559.443896:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197559.443918:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403028b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5754 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.444110:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.444125:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.444137:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.444202:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.444211:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.444235:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445197:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c29240302a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445214:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c29240302a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445223:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c29240302a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197559.445233:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788197559.445395:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445403:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445410:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445416:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701387400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197559.445421:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445428:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445440:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c704a46400) 00010000:00010000:1.0:1788197559.445444:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197559.445460:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445467:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030292 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445483:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445489:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445495:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445500:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197559.445503:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445509:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.445517:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c704a46700) 00010000:00010000:1.0:1788197559.445520:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197559.445523:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.447689:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386200/0x167e6c2924030299 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.449398:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403028b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5754 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.449439:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c29240302a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5754 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197559.449449:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:1.0:1788197559.449452:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197559.449456:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386600, rc 0) 00000100:00100000:1.0:1788197559.453928:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:10240:x1875060755293824:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 10051us (18564us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788197559.453941:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:3.0:1788197559.470559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197559.471170:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755293952 00000100:00100000:1.0:1788197559.471180:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755293952 00000100:00100000:1.0:1788197559.471241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:1.0:1788197559.471251:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:10240:x1875060755293952:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788197559.471378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:10240:x1875060755293952:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 Request processed in 128us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197559.471386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:2.0:1788197559.664104:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776303360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197559.664199:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197559.667060:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776303360 00000100:00100000:0.0:1788197559.667075:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776303360 00000100:00100000:0.0:1788197559.667146:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788197559.667159:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776303360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197559.667203:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197559.667574:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776303360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 417us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197559.667583:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788197559.668289:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7368ad500 x1875060776303360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197559.668326:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776303360:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788197559.791323:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788197559.920586:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197560.174377:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776303488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197560.174442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197560.175603:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776303488 00000100:00100000:0.0:1788197560.175621:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776303488 00000100:00100000:0.0:1788197560.175692:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788197560.175705:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776303488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197560.175756:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197560.175856:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776303488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197560.175864:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788197560.175918:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776303488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197560.942665:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197561.573576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197561.573616:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755294080 00000100:00100000:0.0:1788197561.573627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755294080 00000100:00100000:0.0:1788197561.573692:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:0.0:1788197561.573704:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:10283:x1875060755294080:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197561.573725:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197561.573757:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d575b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.573849:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.573865:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.573875:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.573888:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.573894:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.573900:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574080:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574088:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574094:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574099:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197561.574103:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574121:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574132:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46a00) 00010000:00010000:0.0:1788197561.574135:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197561.574141:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574147:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240302b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574158:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574164:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574172:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574176:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197561.574178:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574196:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574203:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c719ede300) 00010000:00010000:0.0:1788197561.574206:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197561.574209:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574225:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574259:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d575b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574269:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46a00) 00010000:00010000:0.0:1788197561.574271:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197561.574274:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d575b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.574283:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031a00, rc 0) 00000100:00100000:0.0:1788197561.574339:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:10283:x1875060755294080:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 639us (773us total) trans 0 rc 301/301 00000100:00100000:0.0:1788197561.574347:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00080000:1.0:1788197561.574629:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197561.595625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197561.595693:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755294336 00000100:00100000:0.0:1788197561.595703:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755294336 00000100:00100000:0.0:1788197561.597404:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:0.0:1788197561.597419:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:10283:x1875060755294336:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:0.0:1788197561.597477:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197561.597504:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030268 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5746 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.597522:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46a00) 00010000:00010000:0.0:1788197561.597531:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197561.598160:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.598184:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.598194:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.598209:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.598216:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.598222:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197561.603547:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788197561.603565:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.603575:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.603585:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.603601:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197561.603605:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.603612:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.603629:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede300) 00010000:00010000:1.0:1788197561.603632:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197561.603636:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.603643:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240302c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197561.603660:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e177bcad reply state 00000000f5966531 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197561.603669:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788197561.606289:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:10283:x1875060755294336:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 8862us (10662us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788197561.606302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00010000:00010000:2.0:1788197561.610123:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.610139:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.610147:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.610153:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197561.610158:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.610165:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.610181:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c719ede000) 00010000:00010000:2.0:1788197561.610194:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197561.610199:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.610204:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240302ca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197561.741414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197561.741774:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755294464 00000100:00100000:0.0:1788197561.741784:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755294464 00000100:00100000:0.0:1788197561.741869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:0.0:1788197561.741879:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:10291:x1875060755294464:12345-192.168.206.40@tcp:101:lctl.0 00010000:00010000:0.0:1788197561.741903:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197561.741923:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240302d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5762 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.741992:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c29240302d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.742006:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c29240302d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.742016:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c29240302d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197561.742055:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788197561.742059:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197561.742094:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c29240302d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.742117:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240302d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5762 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.742134:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c29240302d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5762 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.742143:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:0.0:1788197561.742146:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197561.742149:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030a00, rc 0) 00000100:00100000:0.0:1788197561.742211:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:10291:x1875060755294464:12345-192.168.206.40@tcp:101:lctl.0 Request processed in 333us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197561.742219:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:1.0:1788197561.838754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197561.839076:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755294592 00000100:00100000:3.0:1788197561.839089:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755294592 00000100:00100000:3.0:1788197561.839196:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:3.0:1788197561.839210:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:10297:x1875060755294592:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1788197561.839238:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197561.839263:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240302df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5769 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839350:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839369:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839385:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839402:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839409:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839416:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839544:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7600/0x167e6c29240302f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839553:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7600/0x167e6c29240302f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839560:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7600/0x167e6c29240302f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197561.839603:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788197561.839607:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197561.839652:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7600/0x167e6c29240302f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839665:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839672:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839679:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839685:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197561.839689:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839697:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839711:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:3.0:1788197561.839714:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197561.839719:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839726:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240302e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839750:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839767:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839774:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839778:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197561.839782:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839789:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839798:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93c7065f6600) 00010000:00010000:3.0:1788197561.839801:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197561.839804:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839810:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240302ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839900:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240302df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5769 expref: 12 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839915:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7600/0x167e6c29240302f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5769 expref: 11 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.839923:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197561.839926:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788197561.839934:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7600, rc 0) 00000100:00100000:3.0:1788197561.840115:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:10297:x1875060755294592:12345-192.168.206.40@tcp:101:bash.0 Request processed in 907us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197561.840124:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:0.0:1788197561.850282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197561.850399:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755294848 00000100:00100000:2.0:1788197561.850409:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755294848 00000100:00100000:2.0:1788197561.850533:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:2.0:1788197561.850545:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:10297:x1875060755294848:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197561.850567:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197561.850585:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240302fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5770 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.850709:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.850723:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.850750:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.850817:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.851062:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.851070:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788197561.851607:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788197561.851792:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.851802:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.851811:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852294:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852302:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852310:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852316:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197561.852320:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852327:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852339:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197561.852342:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197561.852346:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852352:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030302 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197561.852365:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce352b57 reply state 000000004727de76 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197561.852374:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788197561.852408:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240302fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852437:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197561.852445:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:2.0:1788197561.852447:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197561.852449:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d000, rc 0) 00000100:00100000:2.0:1788197561.852510:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10297:x1875060755294848:12345-192.168.206.40@tcp:101:bash.0 Request processed in 1968us (2239us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788197561.852581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00010000:00010000:0.0:1788197561.854696:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.854713:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.854720:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.854726:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197561.854755:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.854764:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.854784:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4100) 00010000:00010000:0.0:1788197561.854788:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197561.854793:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197561.854799:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030309 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197561.859225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197561.859333:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755294976 00000100:00100000:3.0:1788197561.859343:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755294976 00000100:00100000:3.0:1788197561.859385:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1788197561.859394:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1875060755294976:12345-192.168.206.40@tcp:8:bash.0 00010000:00080000:3.0:1788197561.859427:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1788197561.859460:0:6698:0:(genops.c:1385:class_connect()) connect: client 87c79f47-cb13-4c8a-942c-8f23eb455b39, cookie 0x167e6c292403031e 00002000:00100000:3.0:1788197561.859472:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 87c79f47-cb13-4c8a-942c-8f23eb455b39/ffff93c740fe9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788197561.859495:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788197561.859716:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788197561.859757:0:6698:0:(import.c:65:import_set_state_nolock()) ffff93c740fec800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197561.859860:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2356:x1875060755294976:12345-192.168.206.40@tcp:8:bash.0 Request processed in 465us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197561.859868:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:2.0:1788197561.864065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197561.864144:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755295104 00000100:00100000:1.0:1788197561.864154:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755295104 00000100:00100000:1.0:1788197561.864238:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:1.0:1788197561.864249:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:0:x1875060755295104:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1788197561.864266:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197561.864289:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5777 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788197561.864327:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788197561.864346:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1788197561.864350:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197561.864360:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.864379:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.864393:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387400, rc 0) 00000100:00100000:1.0:1788197561.864451:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:0:x1875060755295104:12345-192.168.206.40@tcp:101:bash.0 Request processed in 204us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197561.864458:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00080000:2.0:1788197561.864674:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788197561.866569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197561.866660:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755295232 00000100:00100000:1.0:1788197561.866670:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755295232 00000100:00100000:1.0:1788197561.866721:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:1.0:1788197561.866742:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:10297:x1875060755295232:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1788197561.866759:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197561.866777:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d577e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.866808:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.866940:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197561.866945:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197561.866951:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.866984:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197561.866997:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 8 pid: 6699 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197561.867011:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776303616:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197561.867092:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707fbe480 going to sleep for 11 seconds 00000100:00100000:3.0:1788197561.878043:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776303616:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197561.878079:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.878100:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386200, rc 0) 00000100:00100000:3.0:1788197561.878214:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:10297:x1875060755295232:12345-192.168.206.40@tcp:101:bash.0 Request processed in 11482us (11654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197561.878241:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1788197561.881501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197561.881644:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755295360 00000100:00100000:3.0:1788197561.881654:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755295360 00010000:00010000:3.0:1788197561.881693:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 8 pid: 6699 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197561.881745:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:3.0:1788197561.881756:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755295360:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197561.881771:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197561.881795:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 8 pid: 6699 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.881809:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 8 pid: 6699 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.881879:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000197b5e61/0x167e6c2924030325 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5777 expref: 8 pid: 6699 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.881899:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197561.881903:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197561.881912:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.881923:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197561.882000:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197561.882016:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70910b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875060776303744:192.168.206.40@tcp:105: 00000100:00100000:3.0:1788197561.882122:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788197561.885707:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70910b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875060776303744:192.168.206.40@tcp:105: 00010000:00010000:3.0:1788197561.885741:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197561.885796:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755295360:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 4041us (4304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197561.885806:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:1.0:1788197561.895272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197561.895373:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755295616 00000100:00100000:2.0:1788197561.895384:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755295616 00000100:00100000:2.0:1788197561.895444:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:2.0:1788197561.895454:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:10297:x1875060755295616:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:2.0:1788197561.895987:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10297:x1875060755295616:12345-192.168.206.40@tcp:35:bash.0 Request processed in 533us (725us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788197561.895995:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00010000:00010000:3.0:1788197561.969049:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197562.045034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197562.045128:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755295872 00000100:00100000:3.0:1788197562.045143:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755295872 00000100:00100000:3.0:1788197562.045227:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1788197562.045238:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10307:x1875060755295872:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197562.045264:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197562.045286:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5785 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197562.045392:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788197562.045792:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030333 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5785 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.045806:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:3.0:1788197562.045868:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788197562.046136:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5785 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.046155:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7c00, rc 0) 00000100:00100000:3.0:1788197562.046274:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10307:x1875060755295872:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1036us (1255us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788197562.046282:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:1.0:1788197562.056214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.056636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755296128 00000100:00100000:2.0:1788197562.056645:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755296128 00000100:00100000:2.0:1788197562.056703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:2.0:1788197562.056714:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10307:x1875060755296128:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197562.057706:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:10307:x1875060755296128:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 989us (1496us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788197562.057724:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:1.0:1788197562.150324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.150424:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755296256 00000100:00100000:2.0:1788197562.150434:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755296256 00000100:00100000:2.0:1788197562.150504:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1788197562.150514:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:10313:x1875060755296256:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197562.150554:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197562.150574:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d578c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.150645:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.150659:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.150670:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197562.150703:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788197562.150706:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197562.150723:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.150763:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d578c expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.150780:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d578c expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.150806:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197562.150810:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788197562.150814:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197562.150929:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:10313:x1875060755296256:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 415us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197562.150936:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:3.0:1788197562.155778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197562.156073:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755296512 00000100:00100000:1.0:1788197562.156085:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755296512 00000100:00100000:1.0:1788197562.156155:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:1.0:1788197562.156167:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:10313:x1875060755296512:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197562.156191:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197562.156214:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403034f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5793 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.156313:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.156343:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.156357:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197562.156372:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788197562.156541:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c292403034f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5793 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.156565:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5793 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.156574:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:1.0:1788197562.156577:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197562.156580:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387400, rc 0) 00000100:00100000:1.0:1788197562.156916:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10313:x1875060755296512:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 750us (1147us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788197562.156924:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:1.0:1788197562.160807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197562.160992:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755296640 00000100:00100000:3.0:1788197562.161002:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755296640 00000100:00100000:3.0:1788197562.161073:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:3.0:1788197562.161083:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:2360:x1875060755296640:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197562.161099:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197562.161127:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387400/0x167e6c2924030356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5793 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.161150:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:3.0:1788197562.161155:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197562.161213:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:2360:x1875060755296640:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 131us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197562.161221:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1788197562.165244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197562.165321:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755296896 00000100:00100000:1.0:1788197562.165332:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755296896 00000100:00100000:1.0:1788197562.165382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:1.0:1788197562.165392:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:10313:x1875060755296896:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197562.165418:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197562.165439:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030364 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d579a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.165581:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403036b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.165596:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403036b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.165608:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403036b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197562.165623:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788197562.165761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387e00/0x167e6c2924030364 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d579a expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.165783:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403036b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d579a expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.165792:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:1.0:1788197562.165794:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788197562.165798:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7420c3e00, rc 0) 00000100:00100000:1.0:1788197562.166110:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10313:x1875060755296896:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 717us (1285us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788197562.166117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:2.0:1788197562.175236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197562.175441:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755297024 00000100:00100000:1.0:1788197562.175458:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755297024 00000100:00100000:1.0:1788197562.175776:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:1.0:1788197562.175787:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755297024:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:1.0:1788197562.175889:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.175917:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.175926:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197562.175931:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197562.175936:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.176183:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.176198:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197562.176211:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7012ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1875060776303872:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197562.176436:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788197562.179219:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7012ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1875060776303872:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197562.179265:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197562.181114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197562.181274:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755297152 00000100:00100000:1.0:1788197562.181284:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755297152 00002000:00100000:1.0:1788197562.181332:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93c7414aad80 x1875060755297152/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:458/0 lens 504/0 e 0 to 0 dl 1788197573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788197562.181363:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c7414aad80 with x1875060755297152 ext(0->12) 00010000:00010000:1.0:1788197562.181373:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 8 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.181388:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 8 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788197562.181396:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c7414aad80 00000100:00100000:1.0:1788197562.181425:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1788197562.181434:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755297152:12345-192.168.206.40@tcp:4:lfs.0 00000001:00100000:0.0:1788197562.222852:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000001:00080000:2.0:1788197562.249387:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788197562.250213:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755297152:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 68771us (69099us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788197562.250226:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00002000:00100000:1.0:1788197562.250239:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93c7414aad80 x1875060755297152/t4294967299(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:458/0 lens 504/448 e 0 to 0 dl 1788197573 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788197562.250249:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c7414aad80 with x1875060755297152 ext(0->12) 00010000:00010000:1.0:1788197562.250260:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.250280:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788197562.250288:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c7414aad80 00000100:00100000:1.0:1788197562.254430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197562.254603:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755297280 00000100:00100000:0.0:1788197562.254614:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755297280 00010000:00010000:0.0:1788197562.254654:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197562.254820:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:0.0:1788197562.254859:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755297280:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197562.254886:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788197562.254913:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788197562.254916:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788197561 00002000:00010000:0.0:1788197562.254919:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788197561 00002000:00010000:0.0:1788197562.254921:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788197561 00002000:00010000:0.0:1788197562.254923:0:5826:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788197562.254929:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.254959:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.255179:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a569edbd/0x167e6c292403032c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d577e expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.255200:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788197562.255205:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788197562.255212:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.255222:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.255254:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197562.255310:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755297280:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 453us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197562.255319:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00010000:00010000:1.0:1788197562.255499:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255510:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255544:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255553:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255561:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255568:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfc00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197562.255572:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255581:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255594:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.255602:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf8976d/0x167e6c2924030379 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197562.255684:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755297024:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 79899us (80458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197562.255693:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:1.0:1788197562.259751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197562.260123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755297536 00000100:00100000:3.0:1788197562.260134:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755297536 00000100:00100000:3.0:1788197562.260201:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:3.0:1788197562.260212:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10313:x1875060755297536:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:3.0:1788197562.260275:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403036b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d579a expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197562.260646:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788197562.260718:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788197562.261600:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788197562.261794:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.262075:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.262087:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.262126:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.262142:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 24 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197562.262169:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776304000:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197562.262270:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706205300 going to sleep for 11 seconds 00000100:00100000:2.0:1788197562.267431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197562.267528:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776304000:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197562.267556:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197562.267679:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755297664 00000100:00100000:3.0:1788197562.267687:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755297664 00010000:00010000:3.0:1788197562.267738:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 25 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197562.267775:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:3.0:1788197562.267784:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:2359:x1875060755297664:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197562.267797:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197562.267814:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 25 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.268160:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 25 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.268183:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5770 expref: 25 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.268197:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:3.0:1788197562.268201:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.268211:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.268219:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.268254:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197562.268341:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:2359:x1875060755297664:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 557us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197562.268350:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00010000:00010000:0.0:1788197562.268407:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.268415:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788197562.268555:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788197562.268776:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788197562.268960:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c706b3f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776304128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788197562.269017:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197562.269046:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c707d659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197562.269179:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776304128 00000100:00100000:3.0:1788197562.269185:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776304128 00000100:00100000:3.0:1788197562.269237:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788197562.269245:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776304128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788197562.269313:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776304128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197562.269332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788197562.269371:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c706b3f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776304128:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788197562.270069:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788197562.270132:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c709109c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776304256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788197562.270173:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197562.270194:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788197562.270210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776304256 00000100:00100000:3.0:1788197562.270214:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776304256 00000100:00100000:3.0:1788197562.270240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197562.270246:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776304256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788197562.270440:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875060776304256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 192us (271us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788197562.270447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197562.270484:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c709109c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776304256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788197562.270529:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788197562.270577:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.270589:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.270598:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.270607:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197562.270614:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.270624:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.270643:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:3.0:1788197562.270647:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788197562.270652:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.270661:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030380 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788197562.270963:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788197562.271158:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788197562.271170:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358417346861ns, next at 359417344716ns, rc = 0 00000001:00080000:3.0:1788197562.271177:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788197562.271214:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:3.0:1788197562.271217:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788197562.271223:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c292403036b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d579a expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197562.271339:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10313:x1875060755297536:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 11127us (11606us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788197562.271347:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000020:00080000:3.0:1788197562.271351:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788197562.273012:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788197562.276545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197562.276616:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755297792 00000100:00100000:3.0:1788197562.276627:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755297792 00000100:00100000:3.0:1788197562.276692:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1788197562.276702:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10313:x1875060755297792:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197562.276728:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197562.276760:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57a1 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.276881:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57a1 expref: 28 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.276896:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57a1 expref: 28 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.276915:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:3.0:1788197562.276919:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788197562.276922:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7e00, rc 0) 00000100:00100000:3.0:1788197562.277380:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10313:x1875060755297792:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 676us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197562.277389:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:1.0:1788197562.282021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.282206:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755298048 00000100:00100000:2.0:1788197562.282221:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755298048 00000100:00100000:2.0:1788197562.282285:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1788197562.282296:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7048c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10313:x1875060755298048:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197562.282563:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7048c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:10313:x1875060755298048:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 268us (552us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788197562.282571:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:0.0:1788197562.391692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197562.392054:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755298304 00000100:00100000:1.0:1788197562.392064:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755298304 00000100:00100000:1.0:1788197562.392170:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:1.0:1788197562.392182:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:10323:x1875060755298304:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197562.392205:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197562.392225:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c292403038e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57a8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197562.392323:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788197562.392455:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c292403038e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57a8 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.392471:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:1.0:1788197562.392474:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197562.392479:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c292403038e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57a8 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197562.392500:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf200, rc 0) 00000100:00100000:1.0:1788197562.392578:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10323:x1875060755298304:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 398us (897us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788197562.392601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:1.0:1788197562.399510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.399995:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755298432 00000100:00100000:2.0:1788197562.400007:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755298432 00000100:00100000:2.0:1788197562.400078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:2.0:1788197562.400089:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10323:x1875060755298432:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:2.0:1788197562.400176:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400195:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400207:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400223:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400249:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400270:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400364:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400373:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400379:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197562.400421:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400432:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400438:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400444:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400450:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197562.400454:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400461:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197562.400484:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197562.400488:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400494:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403039c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400507:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400513:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400518:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400523:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197562.400526:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400532:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400539:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4000) 00010000:00010000:2.0:1788197562.400541:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197562.400543:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400548:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400574:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400580:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400586:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400591:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197562.400594:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400600:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400606:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197562.400608:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197562.400610:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.400616:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197562.401109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10323:x1875060755298432:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 1018us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197562.401120:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:3.0:1788197562.410383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.410553:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755298688 00000100:00100000:2.0:1788197562.410566:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755298688 00000100:00100000:2.0:1788197562.410635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1788197562.410662:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10323:x1875060755298688:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197562.411077:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:10323:x1875060755298688:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 411us (702us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788197562.411085:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1788197562.462057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.462186:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755298944 00000100:00100000:2.0:1788197562.462197:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755298944 00000100:00100000:2.0:1788197562.462673:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:2.0:1788197562.462687:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:10326:x1875060755298944:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197562.462713:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197562.462745:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.462845:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.462860:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.462873:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.462890:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.462897:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.462904:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463145:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463153:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463160:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197562.463169:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788197562.463595:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463604:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463612:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463617:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197562.463622:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463630:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463644:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197562.463647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197562.463652:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463674:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240303b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463689:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463695:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463701:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463706:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197562.463709:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463715:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463724:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4000) 00010000:00010000:2.0:1788197562.463727:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197562.463742:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463747:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463797:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463811:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.463927:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197562.463930:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197562.463932:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d400, rc 0) 00000100:00100000:2.0:1788197562.464007:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:10326:x1875060755298944:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1322us (2069us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788197562.464014:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1788197562.468097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.468200:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755299072 00000100:00100000:2.0:1788197562.468210:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755299072 00000100:00100000:2.0:1788197562.468310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:2.0:1788197562.468321:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:10326:x1875060755299072:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:2.0:1788197562.468393:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468595:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468608:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468633:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468640:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468645:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468651:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197562.468670:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468677:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468688:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197562.468691:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197562.468695:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.468701:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197562.468785:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:10326:x1875060755299072:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 464us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197562.468793:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:1.0:1788197562.474658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.474756:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755299328 00000100:00100000:2.0:1788197562.474767:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755299328 00000100:00100000:2.0:1788197562.474862:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:2.0:1788197562.474871:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:10326:x1875060755299328:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197562.475123:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:10326:x1875060755299328:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 251us (474us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788197562.475131:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1788197562.481504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197562.481561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197562.481773:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755299456 00000100:00100000:3.0:1788197562.481797:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755299456 00000100:00100000:3.0:1788197562.481887:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 286 00000100:00100000:3.0:1788197562.481898:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755299456:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197562.481972:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755299456:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 76us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197562.481979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 286 00000100:00100000:1.0:1788197562.482118:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755299584 00000100:00100000:1.0:1788197562.482123:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755299584 00000100:00100000:1.0:1788197562.482172:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00100000:1.0:1788197562.482179:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2358:x1875060755299584:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197562.482210:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2358:x1875060755299584:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 32us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197562.482215:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00080000:3.0:1788197562.482322:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197562.704119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.704216:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755299840 00000100:00100000:2.0:1788197562.704225:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755299840 00000100:00100000:2.0:1788197562.704290:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:2.0:1788197562.704300:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:10357:x1875060755299840:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:2.0:1788197562.704323:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197562.704356:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57b6 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.704463:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.704478:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.704489:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197562.704500:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788197562.704863:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57b6 expref: 37 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.704881:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57b6 expref: 36 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.704889:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197562.704892:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197562.704896:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155cc00, rc 0) 00000100:00100000:2.0:1788197562.704968:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:10357:x1875060755299840:12345-192.168.206.40@tcp:101:cat.0 Request processed in 669us (857us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788197562.704975:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:0.0:1788197562.708418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.708573:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755300096 00000100:00100000:2.0:1788197562.708594:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755300096 00000100:00100000:2.0:1788197562.708656:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1788197562.708668:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:10357:x1875060755300096:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:2.0:1788197562.709046:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:10357:x1875060755300096:12345-192.168.206.40@tcp:35:cat.0 Request processed in 379us (639us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788197562.709054:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:0.0:1788197562.713699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197562.714170:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755300224 00000100:00100000:3.0:1788197562.714181:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755300224 00000100:00100000:3.0:1788197562.714351:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1788197562.714364:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7066c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:2359:x1875060755300224:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197562.714380:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197562.714404:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c29240303e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57b6 expref: 37 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.714423:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:3.0:1788197562.714428:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197562.714489:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7066c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:2359:x1875060755300224:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 128us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197562.714497:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:1.0:1788197562.783521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.784027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755300480 00000100:00100000:2.0:1788197562.784039:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755300480 00000100:00100000:2.0:1788197562.784110:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1788197562.784121:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:10363:x1875060755300480:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:2.0:1788197562.784143:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197562.784146:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788197562.784171:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d578c expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.784191:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197562.784196:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197562.784211:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57bd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.784307:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.784320:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.784328:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.784362:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.784393:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 36 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197562.784407:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776304384:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197562.784554:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741569cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197562.795277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197562.795998:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755300608 00000100:00100000:0.0:1788197562.796008:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755300608 00010000:00010000:0.0:1788197562.796054:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 37 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197562.796099:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:0.0:1788197562.796109:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:2360:x1875060755300608:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197562.796125:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197562.796133:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 37 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.796146:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 37 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.796172:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:0.0:1788197562.796194:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.796205:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.796214:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197562.796236:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197562.796302:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:2360:x1875060755300608:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 195us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197562.796310:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00010000:00010000:2.0:1788197562.797034:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240303c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57af expref: 36 pid: 5841 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197562.797056:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776304384:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197562.797094:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.797104:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.797111:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197562.797130:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788197562.797644:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c29240303f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.797660:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.797668:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197562.797680:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788197562.797684:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d200, rc 0) 00000100:00100000:2.0:1788197562.801654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:10363:x1875060755300480:12345-192.168.206.40@tcp:101:dd.0 Request processed in 17519us (18137us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788197562.801666:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:1.0:1788197562.809705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197562.816220:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755300864 00000100:00100000:2.0:1788197562.816239:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755300864 00000100:00100000:2.0:1788197562.816316:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:2.0:1788197562.816327:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:10363:x1875060755300864:12345-192.168.206.40@tcp:36:dd.0 00010000:00010000:2.0:1788197562.816613:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.816631:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.816642:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197562.816694:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788197562.816719:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005589b9d6 reply state 000000003630c275 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197562.816741:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197562.816859:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+39:10363:x1875060755300864:12345-192.168.206.40@tcp:36:dd.0 Request processed in 533us (7164us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788197562.816867:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000020:00080000:2.0:1788197562.816871:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788197562.821005:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.821023:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.821052:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.821059:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197562.821065:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.821072:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.821090:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197562.821094:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197562.821098:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197562.821105:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030405 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197562.990111:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197563.265772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.265868:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755300992 00000100:00100000:2.0:1788197563.265878:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755300992 00000100:00100000:2.0:1788197563.265940:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:2.0:1788197563.265950:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:10377:x1875060755300992:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:2.0:1788197563.265973:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197563.265992:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403040c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57c4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266051:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266064:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266089:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266103:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266111:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266116:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266393:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266405:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266413:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266455:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.266470:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 39 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197563.266484:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776304512:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197563.266565:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741569780 going to sleep for 11 seconds 00000100:00080000:3.0:1788197563.267722:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197563.273043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.273071:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755301248 00000100:00100000:2.0:1788197563.273078:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755301248 00000100:00100000:2.0:1788197563.273120:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1788197563.273129:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:5597:x1875060755301248:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788197563.273551:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+41:5597:x1875060755301248:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 421us (519us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788197563.273559:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:3.0:1788197563.273956:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776304512:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197563.273980:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197563.280450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197563.280495:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755301376 00000100:00100000:1.0:1788197563.280505:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755301376 00010000:00010000:1.0:1788197563.281397:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 41 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197563.281450:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:1.0:1788197563.281463:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+41:2360:x1875060755301376:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197563.281481:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197563.281490:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 41 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281534:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 41 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281559:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240303f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57bd expref: 41 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281579:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:1.0:1788197563.281585:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281596:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281603:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281636:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197563.281702:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:2360:x1875060755301376:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 241us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197563.281711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00010000:00010000:1.0:1788197563.281753:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281761:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197563.281815:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788197563.281844:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197563.281894:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281917:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281928:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281947:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281954:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281960:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197563.281965:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281974:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281984:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:1.0:1788197563.281987:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197563.281990:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.281997:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282008:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282013:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282026:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282030:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197563.282033:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282039:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282047:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4b00) 00010000:00010000:1.0:1788197563.282049:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197563.282052:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282057:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403041a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282093:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403040c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57c4 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282107:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57c4 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.282114:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:1.0:1788197563.282116:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197563.282118:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155ca00, rc 0) 00000100:00100000:1.0:1788197563.282146:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+39:10377:x1875060755300992:12345-192.168.206.40@tcp:101:stat.0 Request processed in 16198us (16384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197563.282162:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00000001:00080000:2.0:1788197563.292895:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:2.0:1788197563.292917:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000001:00080000:2.0:1788197563.292927:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:2.0:1788197563.293169:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788197563.293195:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c73c2db840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788197563.293201:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c704b5e200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c73c2dbd80 00000020:00080000:2.0:1788197563.293204:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c704b5e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c721ecf400 00000020:00080000:1.0:1788197563.293272:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788197563.293400:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788197563.293689:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c709108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776304640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788197563.293776:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197563.294078:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776304640 00000100:00100000:3.0:1788197563.294099:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776304640 00000100:00100000:3.0:1788197563.294153:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788197563.294163:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776304640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788197563.294190:0:8021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788197563.294226:0:8021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a95bab9, atime: 0x6a95bab9, ctime: 0x6a95bab9, blocks: 0xb 00010000:00010000:3.0:1788197563.294236:0:8021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.294254:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788197563.294259:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197563.294266:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.294281:0:8021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.294292:0:8021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.294299:0:8021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.294392:0:8021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788197563.295188:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875060776304640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1022us (1407us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788197563.295199:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1788197563.297659:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c709108e00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788197563.297677:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c709108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776304640:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788197563.298559:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197563.298573:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.298587:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7c00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197563.298593:0:8526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.298604:0:8526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.298652:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.298660:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e97f40f/0x167e6c2924030428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.298685:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197563.298687:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197563.298689:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197563.380906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197563.381006:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755301632 00000100:00100000:1.0:1788197563.381017:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755301632 00000100:00100000:1.0:1788197563.381078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:1.0:1788197563.381088:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:10383:x1875060755301632:12345-192.168.206.40@tcp:36:truncate.0 00010000:00010000:1.0:1788197563.381149:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197563.381180:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57c4 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.381200:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:1.0:1788197563.381205:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197563.381447:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.381463:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.381473:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788197563.381528:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788197563.381568:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fc1d174 reply state 00000000c3bcfe37 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197563.381577:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788197563.381779:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10383:x1875060755301632:12345-192.168.206.40@tcp:36:truncate.0 Request processed in 691us (879us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788197563.381786:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 54 00000020:00080000:1.0:1788197563.381792:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788197563.386270:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.386288:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.386297:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.386303:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abee00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197563.386308:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.386316:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.386335:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:0.0:1788197563.386355:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197563.386361:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.386367:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403042f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197563.539818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.539965:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755301760 00000100:00100000:2.0:1788197563.539975:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755301760 00000100:00100000:2.0:1788197563.540019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:2.0:1788197563.540029:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:10397:x1875060755301760:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:2.0:1788197563.540051:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197563.540070:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57cb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540153:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540170:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540182:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540199:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540214:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540220:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540500:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540522:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540529:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197563.540564:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788197563.540568:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197563.540586:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540597:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540604:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540610:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540616:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540632:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197563.540636:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540644:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540655:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197563.540658:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197563.540663:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540669:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403043d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540681:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540687:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540693:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540697:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197563.540700:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540706:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540735:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4200) 00010000:00010000:2.0:1788197563.540738:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197563.540741:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540747:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540781:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540794:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.540802:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197563.540804:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197563.540807:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155da00, rc 0) 00000100:00100000:2.0:1788197563.540933:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10397:x1875060755301760:12345-192.168.206.40@tcp:101:stat.0 Request processed in 903us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197563.540941:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:1.0:1788197563.634189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.634278:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755302016 00000100:00100000:2.0:1788197563.634287:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755302016 00000100:00100000:2.0:1788197563.634345:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:2.0:1788197563.634355:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10407:x1875060755302016:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197563.634376:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197563.634397:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197563.634499:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788197563.634614:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030452 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d2 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.634629:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:2.0:1788197563.634632:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197563.634638:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d2 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.634651:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d800, rc 0) 00000100:00100000:2.0:1788197563.634769:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10407:x1875060755302016:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 415us (592us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788197563.634776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:0.0:1788197563.642407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.642746:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755302272 00000100:00100000:2.0:1788197563.642755:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755302272 00000100:00100000:2.0:1788197563.642817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1788197563.642850:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10407:x1875060755302272:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197563.643116:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:10407:x1875060755302272:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 268us (720us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788197563.643124:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:0.0:1788197563.707174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.707254:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755302528 00000100:00100000:2.0:1788197563.707264:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755302528 00000100:00100000:2.0:1788197563.707329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:2.0:1788197563.707341:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:10413:x1875060755302528:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197563.707368:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197563.707403:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030460 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57d9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.707514:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.707529:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.707538:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.707574:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.707586:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 17 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197563.707600:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776304768:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197563.707703:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741569600 going to sleep for 11 seconds 00000100:00100000:3.0:1788197563.715438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197563.715787:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755302656 00000100:00100000:0.0:1788197563.715799:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755302656 00010000:00010000:0.0:1788197563.715886:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 18 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197563.715928:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:0.0:1788197563.715948:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:2359:x1875060755302656:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197563.715970:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197563.715978:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 18 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.715992:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 18 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197563.715998:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776304768:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197563.716019:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c292403044b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57cb expref: 18 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.716025:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.716037:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:0.0:1788197563.716042:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.716061:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.716069:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.716100:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197563.716187:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:2359:x1875060755302656:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 249us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197563.716195:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00010000:00010000:2.0:1788197563.717268:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.717280:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197563.717311:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788197563.717470:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030460 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.717488:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.717497:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197563.717500:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788197563.717503:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155ca00, rc 0) 00000100:00100000:2.0:1788197563.717662:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:10413:x1875060755302528:12345-192.168.206.40@tcp:101:bash.0 Request processed in 10321us (10499us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788197563.717671:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:3.0:1788197563.722158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.723289:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755302912 00000100:00100000:2.0:1788197563.723301:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755302912 00000100:00100000:2.0:1788197563.723530:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1788197563.723543:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:10413:x1875060755302912:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:2.0:1788197563.723859:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.723878:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.723891:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197563.724343:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788197563.724404:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014d028ef reply state 0000000064383962 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197563.724415:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197563.724542:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10413:x1875060755302912:12345-192.168.206.40@tcp:36:bash.0 Request processed in 997us (2393us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788197563.724551:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000020:00080000:2.0:1788197563.724557:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788197563.726712:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.726741:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.726749:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.726755:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197563.726760:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.726768:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.726784:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:3.0:1788197563.726787:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197563.726791:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.726798:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030475 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197563.730186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197563.730697:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755303040 00000100:00100000:1.0:1788197563.730708:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755303040 00000100:00100000:1.0:1788197563.730852:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:1.0:1788197563.730863:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10413:x1875060755303040:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1788197563.731123:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197563.731147:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c292403047c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.731242:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.731258:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.731268:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.731300:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.731315:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 20 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197563.731345:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7012aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776304896:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197563.731437:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197563.733526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197563.733807:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7012aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776304896:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197563.733861:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197563.734051:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755303168 00000100:00100000:2.0:1788197563.734060:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755303168 00010000:00010000:2.0:1788197563.734099:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 21 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197563.734179:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:2.0:1788197563.734190:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:2360:x1875060755303168:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197563.734209:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197563.734217:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 21 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.734229:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 21 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.734249:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030467 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57d9 expref: 21 pid: 5842 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.734265:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197563.734271:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.734297:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.734304:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.734334:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197563.734397:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:2360:x1875060755303168:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 208us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197563.734405:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00010000:00010000:1.0:1788197563.735066:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.735077:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197563.735127:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788197563.735132:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197563.735164:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.735202:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c292403047c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57e0 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.735221:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57e0 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.735229:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:1.0:1788197563.735232:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197563.735235:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe000, rc 0) 00000100:00100000:1.0:1788197563.735287:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10413:x1875060755303040:12345-192.168.206.40@tcp:101:bash.0 Request processed in 4426us (5113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197563.735304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:0.0:1788197563.737504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197563.737624:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755303424 00000100:00100000:3.0:1788197563.737632:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755303424 00000100:00100000:3.0:1788197563.737682:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1788197563.737693:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7048c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10413:x1875060755303424:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:3.0:1788197563.737958:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7048c0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10413:x1875060755303424:12345-192.168.206.40@tcp:35:bash.0 Request processed in 265us (461us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788197563.737976:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:0.0:1788197563.815542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197563.815687:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755303680 00000100:00100000:1.0:1788197563.815697:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755303680 00000100:00100000:1.0:1788197563.815766:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:1.0:1788197563.815777:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10423:x1875060755303680:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197563.815800:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197563.815849:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c292403048a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57e7 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197563.815956:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788197563.816077:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c292403048a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57e7 expref: 22 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.816092:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:1.0:1788197563.816096:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197563.816100:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c292403048a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57e7 expref: 22 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.816114:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abec00, rc 0) 00000100:00100000:1.0:1788197563.816171:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10423:x1875060755303680:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 396us (641us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788197563.816178:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:0.0:1788197563.821971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197563.822124:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755303808 00000100:00100000:2.0:1788197563.822137:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755303808 00000100:00100000:2.0:1788197563.822202:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:2.0:1788197563.822215:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10423:x1875060755303808:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:2.0:1788197563.822303:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822322:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822334:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822349:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822356:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822361:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822673:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822682:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822690:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197563.822738:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822751:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822757:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822765:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822771:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197563.822775:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822783:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822794:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197563.822797:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197563.822802:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c2924030498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822863:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822870:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822876:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822881:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197563.822885:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822891:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822900:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4200) 00010000:00010000:2.0:1788197563.822903:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197563.822906:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822911:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c292403049f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822925:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822931:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822942:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822948:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197563.822951:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822957:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822964:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197563.822967:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197563.822969:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197563.822975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240304a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197563.823042:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10423:x1875060755303808:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 829us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197563.823051:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:0.0:1788197563.825283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197563.825360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755304064 00000100:00100000:3.0:1788197563.825369:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755304064 00000100:00100000:3.0:1788197563.825424:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1788197563.825434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10423:x1875060755304064:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1788197563.825651:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:10423:x1875060755304064:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 218us (376us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788197563.825659:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:0.0:1788197563.886804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197563.886910:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755304320 00000100:00100000:1.0:1788197563.886920:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755304320 00000100:00100000:1.0:1788197563.886979:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:1.0:1788197563.886990:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:10426:x1875060755304320:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197563.887030:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197563.887051:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c29240304ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57ee expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887126:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887140:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887152:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887166:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887172:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887179:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887461:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c29240304c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887471:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c29240304c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887479:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c29240304c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197563.887488:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788197563.887579:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887587:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887593:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887599:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abea00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197563.887603:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887610:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887623:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:1.0:1788197563.887626:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197563.887630:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887635:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887649:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887655:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887661:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887666:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abee00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197563.887676:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887682:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887691:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c704a46700) 00010000:00010000:1.0:1788197563.887693:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197563.887696:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887701:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240304bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887756:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c29240304ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57ee expref: 25 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887770:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c29240304c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57ee expref: 24 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197563.887777:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:1.0:1788197563.887779:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197563.887782:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe600, rc 0) 00000100:00100000:1.0:1788197563.887890:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:10426:x1875060755304320:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 901us (1095us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788197563.887899:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:3.0:1788197563.901747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197563.901850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755304448 00000100:00100000:0.0:1788197563.901860:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755304448 00000100:00100000:0.0:1788197563.901936:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1788197563.901946:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:2358:x1875060755304448:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197563.901959:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197563.901981:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c29240304c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57ee expref: 24 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197563.902000:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:0.0:1788197563.902005:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197563.902064:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:2358:x1875060755304448:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197563.902085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1788197563.902557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197563.902617:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755304576 00000100:00100000:3.0:1788197563.902622:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755304576 00000100:00100000:3.0:1788197563.902663:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:3.0:1788197563.902670:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10426:x1875060755304576:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1788197563.902742:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902758:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902769:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902796:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902803:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902864:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902871:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197563.902876:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902884:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902894:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:3.0:1788197563.902898:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788197563.902901:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197563.902908:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197563.902969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10426:x1875060755304576:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 299us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197563.902977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:1.0:1788197563.912213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197563.912345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755304832 00000100:00100000:3.0:1788197563.912355:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755304832 00000100:00100000:3.0:1788197563.912413:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:3.0:1788197563.912426:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10426:x1875060755304832:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1788197563.912659:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:10426:x1875060755304832:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 234us (457us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788197563.912667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00010000:00010000:3.0:1788197564.014096:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197564.100672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197564.101130:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755305088 00000100:00100000:1.0:1788197564.101142:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755305088 00000100:00100000:1.0:1788197564.101208:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:1.0:1788197564.101227:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:10444:x1875060755305088:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:1.0:1788197564.101252:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197564.101271:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57f5 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197564.101364:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240304de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197564.101380:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240304de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197564.101392:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240304de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197564.101404:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788197564.101535:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240304d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57f5 expref: 27 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197564.101557:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240304de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57f5 expref: 26 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197564.101566:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:1.0:1788197564.101569:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788197564.101573:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfa00, rc 0) 00000100:00100000:1.0:1788197564.102497:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10444:x1875060755305088:12345-192.168.206.40@tcp:101:cat.0 Request processed in 1264us (1827us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788197564.102508:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:1.0:1788197564.148372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197564.148489:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755305216 00000100:00100000:3.0:1788197564.148499:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755305216 00000100:00100000:3.0:1788197564.148566:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:3.0:1788197564.148576:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10445:x1875060755305216:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197564.148599:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197564.148617:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d57fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.148885:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240304f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.148901:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240304f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.148912:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240304f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197564.149016:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788197564.149020:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197564.149039:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240304f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.149066:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240304ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57fc expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.149084:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240304f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57fc expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.149092:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197564.149110:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197564.149115:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6200, rc 0) 00000100:00100000:3.0:1788197564.149773:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10445:x1875060755305216:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 603us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197564.149781:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:2.0:1788197564.166011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197564.170047:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755305600 00000100:00100000:3.0:1788197564.170064:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755305600 00000100:00100000:2.0:1788197564.170282:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:2.0:1788197564.170294:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10445:x1875060755305600:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197564.172022:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10445:x1875060755305600:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 1723us (6014us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788197564.172032:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:0.0:1788197564.182405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197564.184397:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755305728 00000100:00100000:3.0:1788197564.184415:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755305728 00000100:00100000:2.0:1788197564.186467:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:2.0:1788197564.186495:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10445:x1875060755305728:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:2.0:1788197564.187280:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788197564.187312:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57e0 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197564.187346:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240304de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57f5 expref: 27 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197564.187360:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57a1 expref: 26 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197564.187371:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:2.0:1788197564.187381:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197564.187455:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:10445:x1875060755305728:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 963us (5063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197564.187463:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1788197564.194354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197564.194879:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755305856 00000100:00100000:2.0:1788197564.194890:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755305856 00000100:00100000:2.0:1788197564.194951:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:2.0:1788197564.194962:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:10445:x1875060755305856:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:2.0:1788197564.195083:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197564.195102:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197564.195114:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197564.199772:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788197564.200006:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788197564.200087:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788197564.200224:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:10445:x1875060755305856:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 5258us (5878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197564.200236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:1.0:1788197564.267944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197564.268046:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755305984 00000100:00100000:3.0:1788197564.268056:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755305984 00000100:00100000:3.0:1788197564.268115:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:3.0:1788197564.268126:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:10447:x1875060755305984:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197564.268149:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197564.268171:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030501 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5803 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268240:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268254:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268265:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268279:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268286:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268312:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268522:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268531:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268539:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197564.268576:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788197564.268581:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197564.268602:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268614:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268771:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268777:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268784:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268791:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197564.268795:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268810:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268856:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197564.268860:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197564.268864:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268870:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268884:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268891:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268896:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268901:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197564.268904:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268909:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268917:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7065f6300) 00010000:00010000:3.0:1788197564.268919:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197564.268922:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268938:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403050f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268976:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030501 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268989:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.268997:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:3.0:1788197564.269000:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197564.269003:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7000, rc 0) 00000100:00100000:3.0:1788197564.269073:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10447:x1875060755305984:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 948us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197564.269080:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:0.0:1788197564.270390:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776305152:0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.270446:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197564.270495:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776305664:0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.270520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197564.270551:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197564.270557:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776305280:0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.270579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197564.270614:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776305664 00000100:00100000:0.0:1788197564.270632:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776305664 00000100:00100000:0.0:1788197564.270686:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788197564.270697:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776305664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.270754:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776305664:12345-0@lo:400:kworker.0 Request processed in 59us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197564.270761:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788197564.270781:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788197564.270808:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776305664:0@lo:400:kworker.0 00000100:00100000:2.0:1788197564.271019:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776305024:0@lo:400:kworker.0 00000100:00100000:2.0:1788197564.271052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197564.271083:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776305536:0@lo:400:kworker.0 00000100:00100000:2.0:1788197564.271117:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197564.271135:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197564.271140:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776305408:0@lo:400:kworker.0 00000100:00100000:2.0:1788197564.271161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197564.271190:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776305152 00000100:00100000:2.0:1788197564.271194:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776305152 00000100:00100000:2.0:1788197564.271219:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776305280 00000100:00100000:2.0:1788197564.271222:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776305280 00000100:00100000:2.0:1788197564.271239:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776305536 00000100:00100000:2.0:1788197564.271242:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776305536 00000100:00100000:2.0:1788197564.271258:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788197564.271264:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776305152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197564.271298:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776305152:12345-0@lo:400:kworker.0 Request processed in 34us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197564.271305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788197564.271319:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788197564.271325:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776305280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197564.271366:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776305280:12345-0@lo:400:kworker.0 Request processed in 41us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197564.271372:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788197564.271384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788197564.271390:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776305536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197564.271396:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776305408 00000100:00100000:1.0:1788197564.271399:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776305408 00000100:00100000:2.0:1788197564.271421:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776305536:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197564.271425:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788197564.271427:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788197564.271431:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776305408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197564.271449:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776305536:0@lo:400:kworker.0 00000100:00100000:1.0:1788197564.271462:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776305408:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197564.271463:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776305408:0@lo:400:kworker.0 00000100:00100000:1.0:1788197564.271468:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788197564.274933:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776305024 00000100:00100000:0.0:1788197564.274950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776305024 00000100:00100000:0.0:1788197564.275017:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788197564.275028:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776305024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.275134:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776305024:12345-0@lo:400:kworker.0 Request processed in 108us (4081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197564.275160:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:0.0:1788197564.275207:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197564.275214:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197564.275248:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776305024:0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.275295:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776305280:0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.275310:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776305152:0@lo:400:kworker.0 00000100:00100000:0.0:1788197564.785682:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776305792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197564.785757:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197564.785864:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776305792 00000100:00100000:0.0:1788197564.785872:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776305792 00000100:00100000:0.0:1788197564.785913:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788197564.785923:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875060776305792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197564.785961:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197564.786004:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875060776305792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197564.786012:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788197564.786063:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776305792:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788197564.910475:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788197564.910485:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788197564.910532:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788197564.910539:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788197564.910664:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7012a9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776305920:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788197564.911012:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70ae23480 going to sleep for 11 seconds 00000100:00100000:2.0:1788197564.913294:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7012a9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776305920:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788197564.918882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197564.919083:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755306112 00000100:00100000:3.0:1788197564.919092:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755306112 00000100:00100000:3.0:1788197564.919155:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:3.0:1788197564.919165:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10458:x1875060755306112:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788197564.919237:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10458:x1875060755306112:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 Request processed in 73us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197564.919245:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:2.0:1788197564.923139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197564.923301:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755306240 00000100:00100000:0.0:1788197564.923311:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755306240 00000100:00100000:0.0:1788197564.923379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:0.0:1788197564.923390:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10458:x1875060755306240:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788197564.923422:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788197564.923538:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10458:x1875060755306240:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 150us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197564.923557:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:1.0:1788197564.936031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197564.936428:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755306368 00000100:00100000:3.0:1788197564.936441:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755306368 00000100:00100000:3.0:1788197564.936516:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:3.0:1788197564.936528:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10458:x1875060755306368:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788197564.936758:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.936777:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.936793:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.936809:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.936816:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.936985:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937654:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937668:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937677:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197564.937736:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788197564.937741:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197564.937755:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937768:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937784:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937791:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937798:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197564.937802:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.937810:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938017:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:3.0:1788197564.938022:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197564.938027:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938034:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c292403051d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938050:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938056:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938061:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938477:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197564.938491:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938499:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938509:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93c7065f6300) 00010000:00010000:3.0:1788197564.938512:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197564.938515:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938522:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030524 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938729:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938737:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938744:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938752:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197564.938756:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938762:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938771:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:3.0:1788197564.938774:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197564.938783:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197564.938789:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c292403052b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197564.938985:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10458:x1875060755306368:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 2455us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197564.938995:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:3.0:1788197564.972776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197564.973025:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755306624 00000100:00100000:0.0:1788197564.973036:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755306624 00000100:00100000:0.0:1788197564.973116:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:0.0:1788197564.973129:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10458:x1875060755306624:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197564.973157:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197564.973188:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030532 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d580a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973314:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973330:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973343:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197564.973354:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788197564.973479:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973487:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973492:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973497:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197564.973502:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973522:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973535:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:0.0:1788197564.973544:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197564.973549:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973604:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030532 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d580a expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973615:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:0.0:1788197564.973617:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197564.973621:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030532 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d580a expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.973634:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031a00, rc 0) 00000100:00100000:0.0:1788197564.973712:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10458:x1875060755306624:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 586us (952us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788197564.973728:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:1.0:1788197564.978024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197564.978163:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755306752 00000100:00100000:0.0:1788197564.978172:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755306752 00000100:00100000:0.0:1788197564.978231:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:0.0:1788197564.978241:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10458:x1875060755306752:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788197564.978294:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788197564.978419:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10458:x1875060755306752:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 178us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197564.978427:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:1.0:1788197564.985794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197564.985973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755307008 00000100:00100000:0.0:1788197564.985983:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755307008 00000100:00100000:0.0:1788197564.986039:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:0.0:1788197564.986049:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10458:x1875060755307008:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197564.986070:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197564.986073:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788197564.986102:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240304f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d57fc expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.986122:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197564.986127:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197564.986140:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030547 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5811 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788197564.986941:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788197564.987220:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403054e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.987235:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403054e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.987245:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403054e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.987318:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030547 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5811 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.987333:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403054e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5811 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.987341:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c719edea00) 00010000:00010000:0.0:1788197564.987344:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197564.987347:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030800, rc 0) 00000100:00100000:0.0:1788197564.987416:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10458:x1875060755307008:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1368us (1633us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788197564.987426:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:1.0:1788197564.991623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197564.995582:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755307264 00000100:00100000:0.0:1788197564.995600:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755307264 00000100:00100000:0.0:1788197564.995815:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:0.0:1788197564.995847:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10458:x1875060755307264:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788197564.995913:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197564.995942:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403054e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5811 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.995959:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c719edea00) 00010000:00010000:0.0:1788197564.995971:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197564.995996:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996008:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996033:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996050:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996057:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996063:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996257:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996265:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996271:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996277:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197564.996281:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996289:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996299:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197564.996301:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197564.996305:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996317:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403055c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996328:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996334:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996340:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996345:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197564.996348:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996355:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996363:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9ac9495d (ffff93c719edec00) 00010000:00010000:0.0:1788197564.996365:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197564.996367:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197564.996373:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030563 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9ac9495d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197564.998051:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10458:x1875060755307264:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 2197us (6428us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788197564.998062:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:1.0:1788197565.003480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197565.003617:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755307392 00000100:00100000:2.0:1788197565.003627:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755307392 00000100:00100000:2.0:1788197565.003712:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00100000:2.0:1788197565.003732:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10458:x1875060755307392:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197565.003751:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197565.003774:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403056a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5818 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.003812:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.003861:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.003892:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.003996:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403056a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.004014:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.004022:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:2.0:1788197565.004025:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788197565.004029:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155cc00, rc 0) 00000100:00100000:2.0:1788197565.004077:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10458:x1875060755307392:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 347us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197565.004083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00080000:0.0:1788197565.004225:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197565.020421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.020506:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755307648 00000100:00100000:3.0:1788197565.020516:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755307648 00000100:00100000:3.0:1788197565.020568:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:3.0:1788197565.020579:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:10458:x1875060755307648:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788197565.020664:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.020679:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.020690:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788197565.021457:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788197565.021468:0:5871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361167644692ns, next at 362167642468ns, rc = 0 00000004:00010000:3.0:1788197565.021620:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049eb710e reply state 00000000a62ca89a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.021631:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788197565.021897:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10458:x1875060755307648:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 1315us (1482us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788197565.021907:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00010000:00010000:3.0:1788197565.035815:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.035866:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.035875:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.035883:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197565.035888:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.035896:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.038129:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:3.0:1788197565.038141:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788197565.038150:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.038161:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030578 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197565.039224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197565.039260:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755307776 00000100:00100000:2.0:1788197565.039269:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755307776 00000100:00100000:2.0:1788197565.039320:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:2.0:1788197565.039330:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:10458:x1875060755307776:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197565.039350:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197565.039368:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d581f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.039425:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.039457:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.039479:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:2.0:1788197565.039482:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197565.039485:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d200, rc 0) 00000100:00100000:2.0:1788197565.039609:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10458:x1875060755307776:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 280us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197565.039617:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00010000:00010000:3.0:1788197565.040421:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197565.052547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197565.052682:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755307904 00000100:00100000:0.0:1788197565.052692:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755307904 00000100:00100000:0.0:1788197565.052747:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1788197565.052755:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875060755307904:12345-192.168.206.40@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788197565.052785:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:0.0:1788197565.052844:0:6696:0:(genops.c:1385:class_connect()) connect: client 87c79f47-cb13-4c8a-942c-8f23eb455b39, cookie 0x167e6c2924030586 00002000:00100000:0.0:1788197565.052857:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 87c79f47-cb13-4c8a-942c-8f23eb455b39/ffff93c737059000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788197565.052878:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788197565.053106:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788197565.053141:0:6696:0:(import.c:65:import_set_state_nolock()) ffff93c73705d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788197565.053225:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2356:x1875060755307904:12345-192.168.206.40@tcp:8:lhsmtool_posix.0 Request processed in 469us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197565.053232:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1788197565.062286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197565.062349:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755308032 00000100:00100000:1.0:1788197565.062361:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755308032 00000100:00100000:1.0:1788197565.062447:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00080000:0.0:1788197565.062457:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197565.062460:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:0:x1875060755308032:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788197565.151725:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:0:x1875060755308032:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 89246us (89428us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788197565.151738:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000001:00100000:3.0:1788197565.151801:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000001:00080000:3.0:1788197565.151814:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1788197565.155768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197565.155969:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755308288 00000100:00100000:0.0:1788197565.155979:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755308288 00000100:00100000:0.0:1788197565.156034:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:0.0:1788197565.156044:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10458:x1875060755308288:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788197565.156279:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:10458:x1875060755308288:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 235us (518us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788197565.156287:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1788197565.164658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197565.164741:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755308544 00000100:00100000:0.0:1788197565.164751:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755308544 00000100:00100000:0.0:1788197565.164847:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:0.0:1788197565.164859:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:10458:x1875060755308544:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788197565.165745:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:10458:x1875060755308544:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 884us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197565.165756:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:3.0:1788197565.173980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197565.174077:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755308672 00000100:00100000:2.0:1788197565.174087:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755308672 00000100:00100000:2.0:1788197565.174172:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:2.0:1788197565.174182:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:10458:x1875060755308672:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197565.174205:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197565.174226:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c292403058d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5826 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.174338:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030594 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.174353:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.174367:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197565.174432:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197565.174452:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.174481:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c292403058d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5826 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.174510:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5826 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.174518:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:2.0:1788197565.174522:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788197565.174526:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c400, rc 0) 00000100:00100000:2.0:1788197565.174581:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10458:x1875060755308672:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 400us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197565.174588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:3.0:1788197565.183942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197565.184154:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755308800 00000100:00100000:0.0:1788197565.184164:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755308800 00000100:00100000:0.0:1788197565.184220:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:0.0:1788197565.184231:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755308800:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197565.184246:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197565.184267:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d582d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788197565.184293:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95babc, blocks: 0x1 00010000:00010000:0.0:1788197565.184311:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1788197565.184315:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197565.184324:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.184344:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.184358:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030800, rc 0) 00000100:00100000:0.0:1788197565.184404:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755308800:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 175us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197565.184417:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:0.0:1788197565.190629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197565.190703:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755309056 00000100:00100000:1.0:1788197565.190722:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755309056 00000100:00100000:1.0:1788197565.190805:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:1.0:1788197565.190816:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10458:x1875060755309056:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788197565.191106:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10458:x1875060755309056:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 291us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197565.191114:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:0.0:1788197565.198765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197565.202326:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755309184 00000100:00100000:1.0:1788197565.202339:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755309184 00000100:00100000:1.0:1788197565.202393:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:1.0:1788197565.202402:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:10458:x1875060755309184:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197565.202418:0:8021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197565.202437:0:8021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5834 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.202465:0:8021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.202474:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197565.202478:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197565.202483:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 7 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.202527:0:8021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.202540:0:8021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 7 pid: 6699 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197565.202567:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776306048:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197565.202662:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709101180 going to sleep for 11 seconds 00000100:00100000:2.0:1788197565.219493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197565.219688:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776306048:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197565.222993:0:8021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 7 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.223024:0:8021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe800, rc 0) 00000100:00100000:1.0:1788197565.223162:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:10458:x1875060755309184:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 20759us (24406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197565.223170:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:0.0:1788197565.223355:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755309312 00000100:00100000:0.0:1788197565.223366:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755309312 00010000:00010000:0.0:1788197565.223406:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 7 pid: 6699 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197565.223446:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:0.0:1788197565.223454:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755309312:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197565.223468:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197565.223491:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 7 pid: 6699 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.227148:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 7 pid: 6699 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.227179:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c292403059b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d582d expref: 7 pid: 6699 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.227194:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197565.227199:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197565.227213:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 6 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.227245:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 6 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.230959:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 6 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197565.230984:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736892680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875060776306176:192.168.206.40@tcp:105: 00000100:00100000:0.0:1788197565.231084:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7081456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197565.238281:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736892680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1875060776306176:192.168.206.40@tcp:105: 00010000:00010000:1.0:1788197565.238308:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197565.238372:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755309312:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 14917us (18892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197565.238384:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1788197565.253957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.254155:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755309440 00000100:00100000:3.0:1788197565.254165:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755309440 00002000:00100000:3.0:1788197565.254208:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93c736d26d80 x1875060755309440/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:461/0 lens 504/0 e 0 to 0 dl 1788197576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197565.254218:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736d26d80 with x1875060755309440 ext(0->8) 00002000:00010000:3.0:1788197565.254223:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c736d26d80 00000100:00100000:3.0:1788197565.254256:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:3.0:1788197565.254266:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755309440:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788197565.255270:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755309440:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 1001us (1320us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788197565.255279:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00002000:00100000:3.0:1788197565.255287:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93c736d26d80 x1875060755309440/t4294967302(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:461/0 lens 504/448 e 0 to 0 dl 1788197576 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197565.255296:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736d26d80 with x1875060755309440 ext(0->8) 00002000:00010000:3.0:1788197565.255300:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c736d26d80 00000100:00100000:3.0:1788197565.269004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.269041:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755309568 00000100:00100000:3.0:1788197565.269050:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755309568 00000100:00100000:3.0:1788197565.269095:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:3.0:1788197565.269104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10458:x1875060755309568:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000040:00080000:1.0:1788197565.278169:0:12019:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788197565.278177:0:12019:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788197565.278213:0:12019:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788197565.278218:0:12019:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788197565.301958:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788197565.301981:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776306304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197565.302047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197565.302123:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776306304 00000100:00100000:1.0:1788197565.302131:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776306304 00000100:00100000:1.0:1788197565.302196:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788197565.302205:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776306304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788197565.302230:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197565.302274:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776306304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197565.302281:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788197565.302327:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776306304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197565.354423:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10458:x1875060755309568:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 85307us (85637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197565.354438:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000001:00080000:1.0:1788197565.354479:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1788197565.354514:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788197565.354549:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788197565.354730:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788197565.354744:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788197565.355471:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776306432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788197565.355537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197565.355611:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776306432 00000100:00100000:1.0:1788197565.355618:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776306432 00000100:00100000:1.0:1788197565.355656:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788197565.355664:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776306432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788197565.356277:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788197565.356281:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788197565 00002000:00010000:1.0:1788197565.356284:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788197565.356286:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788197564 -> 1788197565 00002000:00010000:1.0:1788197565.356289:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788197565.356345:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776306432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 681us (807us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788197565.356353:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788197565.358459:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c737005880/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788197565.358472:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776306432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788197565.359266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.359755:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755309696 00000100:00100000:3.0:1788197565.359764:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755309696 00000100:00100000:3.0:1788197565.360578:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:3.0:1788197565.360603:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755309696:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788197565.412965:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788197565.412983:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788197565.413251:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755309696:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 52646us (53983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197565.413263:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:1.0:1788197565.415521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.418381:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755309952 00000100:00100000:3.0:1788197565.418394:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755309952 00000100:00100000:3.0:1788197565.418458:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:3.0:1788197565.418469:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:10458:x1875060755309952:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788197565.419310:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197565.419345:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5826 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.419362:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:3.0:1788197565.419367:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197565.419397:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.419410:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.419418:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788197565.420317:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f36b876 reply state 0000000061ccc072 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.420329:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788197565.420448:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10458:x1875060755309952:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 1978us (4933us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788197565.420457:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:2.0:1788197565.422815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.422934:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755310080 00000100:00100000:3.0:1788197565.422943:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755310080 00000100:00100000:3.0:1788197565.422989:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:3.0:1788197565.422999:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755310080:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788197565.423221:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788197565.423225:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788197565 -> 1788197563 00002000:00010000:3.0:1788197565.423228:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788197561 00002000:00010000:3.0:1788197565.423230:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788197565 -> 1788197563 00002000:00010000:3.0:1788197565.423232:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788197565.423284:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755310080:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 286us (478us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788197565.423291:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00010000:00010000:1.0:1788197565.424656:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.424670:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.424678:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.424684:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197565.424689:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.424695:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.424710:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:1.0:1788197565.424723:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197565.424727:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.424733:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240305a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.426445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.426477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755310336 00000100:00100000:3.0:1788197565.426485:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755310336 00000100:00100000:3.0:1788197565.426544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:3.0:1788197565.426554:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:10458:x1875060755310336:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788197565.426617:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.426633:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.426642:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.426673:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.426701:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 13 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.426728:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70910ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776306560:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197565.426813:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2db0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197565.430248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.430280:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755310464 00000100:00100000:3.0:1788197565.430286:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755310464 00010000:00010000:3.0:1788197565.430319:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 14 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.430351:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:3.0:1788197565.430359:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2360:x1875060755310464:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197565.430371:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197565.430377:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 14 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.430389:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 14 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.430409:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:3.0:1788197565.430415:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.430424:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.430441:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.430460:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197565.430509:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2360:x1875060755310464:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 151us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197565.430517:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00010000:00010000:0.0:1788197565.431296:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5818 expref: 13 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197565.431312:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70910ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776306560:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197565.431332:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431341:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431347:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431376:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431382:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431401:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431406:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197565.431410:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431417:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431428:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:0.0:1788197565.431431:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788197565.431435:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.431441:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c29240305b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197565.431493:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:10458:x1875060755310336:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 4940us (5054us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788197565.431512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:0.0:1788197565.444090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197565.444230:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755310592 00000100:00100000:2.0:1788197565.444240:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755310592 00000100:00100000:2.0:1788197565.444299:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:2.0:1788197565.444308:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755310592:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788197565.444360:0:8021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.444380:0:8021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 7 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.444389:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197565.444393:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197565.444398:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.444429:0:8021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 7 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.444443:0:8021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 7 pid: 8021 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197565.444457:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776306688:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197565.444538:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741569840 going to sleep for 11 seconds 00000100:00100000:0.0:1788197565.453331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197565.455411:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755310720 00000100:00100000:0.0:1788197565.455428:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755310720 00010000:00010000:0.0:1788197565.455475:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 8 pid: 8021 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197565.455535:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:0.0:1788197565.455564:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755310720:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197565.455584:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197565.455615:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 8 pid: 8021 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.455631:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 8 pid: 8021 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.455661:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788197565.455667:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788197565.455674:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.455687:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.455724:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197565.455796:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755310720:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 238us (2473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197565.455803:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00010000:00010000:2.0:1788197565.460057:0:8021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c29240305a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5834 expref: 7 pid: 8021 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197565.460079:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d25f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776306688:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197565.460104:0:8021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460133:0:8021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460142:0:8021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460175:0:8021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460183:0:8021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460190:0:8021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460196:0:8021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197565.460200:0:8021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460207:0:8021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460225:0:8021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.460243:0:8021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c29240305b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197565.461495:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755310592:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 17177us (17401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197565.461508:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:0.0:1788197565.467026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197565.467093:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755310976 00000100:00100000:2.0:1788197565.467102:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755310976 00000100:00100000:2.0:1788197565.467152:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:2.0:1788197565.467162:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:10458:x1875060755310976:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788197565.467229:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.467244:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.467255:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.467444:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.467457:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.467465:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.467524:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197565.467538:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 13 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197565.467551:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776306816:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197565.467628:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c741569840 going to sleep for 11 seconds 00000100:00100000:0.0:1788197565.471431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197565.471536:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d25f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776306816:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197565.471566:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.471626:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755311104 00000100:00100000:3.0:1788197565.471634:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755311104 00010000:00010000:3.0:1788197565.471679:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 14 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.471732:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1788197565.471741:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2359:x1875060755311104:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197565.471755:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197565.471773:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 14 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.471793:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 14 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.471852:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c292403057f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d581f expref: 14 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.471869:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:3.0:1788197565.471885:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.471906:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.471914:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.472208:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197565.472256:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2359:x1875060755311104:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 515us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197565.472263:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00010000:00010000:0.0:1788197565.473136:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.473147:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788197565.473345:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788197565.473506:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788197565.473553:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788197565.473635:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736891500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776306944:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788197565.473698:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197565.473740:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788197565.474150:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776306944 00000100:00100000:3.0:1788197565.474158:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776306944 00000100:00100000:3.0:1788197565.474218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788197565.474228:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875060776306944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788197565.474311:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875060776306944:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197565.474319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788197565.474425:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788197565.474431:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c737005880, transno 4294967303 00000100:00100000:0.0:1788197565.474451:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736891500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776306944:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788197565.475561:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788197565.475633:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736891500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776307072:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788197565.475684:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197565.475722:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788197565.476479:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776307072 00000100:00100000:3.0:1788197565.476486:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776307072 00000100:00100000:3.0:1788197565.476545:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197565.476556:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875060776307072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788197565.476778:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875060776307072:12345-0@lo:1000:mdt00_000.0 Request processed in 225us (1093us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788197565.477441:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788197565.477851:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736891500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776307072:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788197565.477902:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.477926:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.477934:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.477940:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197565.477945:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.477952:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.477978:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7028a4000) 00010000:00010000:0.0:1788197565.477981:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788197565.477985:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.477991:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c29240305c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478031:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478038:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478043:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478048:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197565.478050:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478055:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478064:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:0.0:1788197565.478066:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788197565.478069:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478074:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240304fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478107:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478119:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478128:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478160:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.478176:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 16 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197565.478190:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736892680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776307200:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197565.478268:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788197565.485362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197565.485445:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755311232 00000100:00100000:1.0:1788197565.485454:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755311232 00010000:00010000:1.0:1788197565.485548:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 17 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197565.485600:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:1.0:1788197565.485612:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:2360:x1875060755311232:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197565.485625:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197565.485633:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 17 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.485646:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 17 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.485671:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:1.0:1788197565.485676:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.485687:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.485696:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197565.485728:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197565.485783:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:2360:x1875060755311232:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 173us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197565.485791:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00010000:00010000:3.0:1788197565.486349:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5803 expref: 16 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.486379:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736892680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776307200:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197565.486398:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486407:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486414:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486425:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486432:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486438:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486444:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197565.486449:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486456:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486468:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:3.0:1788197565.486471:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197565.486474:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.486490:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240305cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.490725:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.490735:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.490742:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.490748:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197565.490753:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.490760:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.491102:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:3.0:1788197565.491106:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788197565.491111:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.491118:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c29240305be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197565.491353:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10458:x1875060755310976:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 24186us (24327us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788197565.491364:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 83 00000020:00080000:3.0:1788197565.491378:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788197565.491911:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788197565.491916:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788197565.491958:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788197565.491963:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788197565.496735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197565.497071:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755311488 00000100:00100000:3.0:1788197565.497082:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755311488 00000100:00100000:3.0:1788197565.497127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1788197565.497137:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10458:x1875060755311488:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788197565.497764:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788197565.498132:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788197565.498185:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.498230:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.498243:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.498251:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.498257:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.498262:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197565.498288:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788197565.498371:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:10458:x1875060755311488:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 1232us (1642us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788197565.498380:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000020:00080000:3.0:1788197565.498385:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788197565.498771:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197565.498787:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.498795:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197565.498800:0:8526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.498809:0:8526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.498863:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93c7065f6300) 00010000:00010000:0.0:1788197565.498866:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788197565.498871:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.498877:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c29240305d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197565.498895:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197565.498897:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197565.498899:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197566.062597:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197567.086184:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788197567.275817:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788197567.277025:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788197567.277096:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788197567.277104:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788197567.397238:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788197567.404326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.404487:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755311744 00000100:00100000:1.0:1788197567.404552:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755311744 00000100:00100000:1.0:1788197567.404621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:1.0:1788197567.404631:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:10477:x1875060755311744:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197567.404654:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197567.404672:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240305da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d583b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.404764:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240305e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.404777:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240305e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.404788:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240305e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197567.404798:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788197567.405139:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240305da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d583b expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.405161:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240305e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d583b expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.405171:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:1.0:1788197567.405174:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788197567.405178:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abea00, rc 0) 00000100:00100000:1.0:1788197567.406008:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10477:x1875060755311744:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1373us (1685us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788197567.406027:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00080000:0.0:1788197567.406108:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197567.409544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197567.410589:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755311872 00000100:00100000:3.0:1788197567.410603:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755311872 00000100:00100000:3.0:1788197567.410662:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:3.0:1788197567.410673:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10477:x1875060755311872:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:3.0:1788197567.410757:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.410773:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.410785:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.410800:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.410807:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.410812:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.411388:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.411397:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.411406:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788197567.411455:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.411466:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.411472:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.411478:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.411483:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197567.412572:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412581:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412594:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197567.412598:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197567.412602:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412607:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c29240305ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412621:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412626:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412638:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412642:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197567.412645:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412651:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412659:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7065f6800) 00010000:00010000:3.0:1788197567.412661:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197567.412664:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412670:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240305f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412683:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412689:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412694:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412699:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197567.412710:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412726:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412735:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6b00) 00010000:00010000:3.0:1788197567.412737:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197567.412740:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.412746:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240305fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197567.413080:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10477:x1875060755311872:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 2404us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197567.413089:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:3.0:1788197567.465262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197567.465296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755312128 00000100:00100000:3.0:1788197567.465305:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755312128 00000100:00100000:3.0:1788197567.465357:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:3.0:1788197567.465367:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10480:x1875060755312128:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197567.465387:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197567.465405:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5842 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465472:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465499:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465525:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465540:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465547:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465553:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465808:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465817:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465861:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197567.465871:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788197567.465972:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465981:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465988:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.465994:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197567.466005:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466013:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466025:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197567.466028:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197567.466032:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466039:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c292403060b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466050:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466056:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466062:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466067:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197567.466070:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466075:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466082:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7065f6b00) 00010000:00010000:3.0:1788197567.466085:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197567.466094:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466101:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466141:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466155:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.466163:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:3.0:1788197567.466165:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788197567.466167:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7000, rc 0) 00000100:00100000:3.0:1788197567.466225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10480:x1875060755312128:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 858us (971us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788197567.466233:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:3.0:1788197567.473366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.473519:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755312256 00000100:00100000:0.0:1788197567.473528:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755312256 00000100:00100000:0.0:1788197567.473588:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:0.0:1788197567.473599:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10480:x1875060755312256:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:0.0:1788197567.473661:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473677:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473688:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473723:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473737:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473753:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473759:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197567.473763:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473771:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473783:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:0.0:1788197567.473786:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197567.473791:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.473797:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197567.473888:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10480:x1875060755312256:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 290us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197567.473896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:3.0:1788197567.479682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.479770:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755312512 00000100:00100000:0.0:1788197567.479780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755312512 00000100:00100000:0.0:1788197567.479877:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:0.0:1788197567.479888:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7048c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10480:x1875060755312512:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:0.0:1788197567.480314:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7048c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:10480:x1875060755312512:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 426us (643us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788197567.480331:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:0.0:1788197567.548806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197567.549132:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755312768 00000100:00100000:3.0:1788197567.549143:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755312768 00000100:00100000:3.0:1788197567.549205:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:3.0:1788197567.549216:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:10000:x1875060755312768:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1788197567.549240:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197567.549259:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403062e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5849 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.549370:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.549625:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.549634:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.549668:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.549681:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 23 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197567.549696:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741119880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776307328:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197567.550558:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2dbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788197567.554112:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741119880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776307328:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197567.554142:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197567.554264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.556053:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755312896 00000100:00100000:1.0:1788197567.556065:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755312896 00010000:00010000:1.0:1788197567.556485:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 24 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197567.556588:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:1.0:1788197567.556602:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:2360:x1875060755312896:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197567.556619:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197567.556628:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 24 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.556642:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 24 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.556668:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c2924030619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5842 expref: 24 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.556684:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:1.0:1788197567.556690:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.556710:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.556716:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.556771:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197567.556894:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:2360:x1875060755312896:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 294us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197567.556902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00010000:00010000:0.0:1788197567.558355:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.558368:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197567.558399:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788197567.558598:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403062e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.558619:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.558628:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:0.0:1788197567.558630:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788197567.558634:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6a00, rc 0) 00000100:00100000:0.0:1788197567.558712:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10000:x1875060755312768:12345-192.168.206.40@tcp:101:bash.0 Request processed in 9488us (9906us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788197567.558720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:3.0:1788197567.563695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.564167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755313152 00000100:00100000:0.0:1788197567.564177:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755313152 00000100:00100000:0.0:1788197567.564267:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:0.0:1788197567.564292:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10000:x1875060755313152:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:0.0:1788197567.564565:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.564582:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.564594:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788197567.564645:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788197567.564668:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f70f77c reply state 00000000da1f078d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197567.564676:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788197567.564731:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788197567.565031:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10000:x1875060755313152:12345-192.168.206.40@tcp:36:bash.0 Request processed in 739us (1344us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788197567.565038:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 89 00000020:00080000:0.0:1788197567.565043:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788197567.574770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:0.0:1788197567.575019:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.575032:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.575039:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.575045:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197567.575050:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.575072:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.575090:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:0.0:1788197567.575093:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197567.575098:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.575105:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030643 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197567.576448:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755313280 00000100:00100000:1.0:1788197567.576461:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755313280 00000100:00100000:1.0:1788197567.576534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:1.0:1788197567.576545:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10000:x1875060755313280:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1788197567.576571:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197567.576605:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403064a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5850 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.576664:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403064a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5850 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.576679:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403064a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5850 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.576698:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:1.0:1788197567.576710:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197567.576714:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfa00, rc 0) 00000100:00100000:1.0:1788197567.576782:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10000:x1875060755313280:12345-192.168.206.40@tcp:101:bash.0 Request processed in 238us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197567.576789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:1.0:1788197567.580784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197567.580889:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755313408 00000100:00100000:3.0:1788197567.580900:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755313408 00000100:00100000:3.0:1788197567.580989:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:3.0:1788197567.581001:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740cf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:10000:x1875060755313408:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1788197567.581020:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197567.581041:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5857 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197567.581068:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a95babb, atime: 0x6a95bab9, ctime: 0x6a95babb, blocks: 0xb 00010000:00010000:3.0:1788197567.581106:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1788197567.581111:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197567.581121:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788197567.581126:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788197567.581141:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.581156:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6e00, rc 0) 00000100:00100000:3.0:1788197567.581231:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740cf3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:10000:x1875060755313408:12345-192.168.206.40@tcp:101:bash.0 Request processed in 232us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197567.581238:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:3.0:1788197567.584042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.584228:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755313536 00000100:00100000:1.0:1788197567.584253:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755313536 00002000:00010000:1.0:1788197567.584295:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788197567.584299:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741119180 with x1875060755313536 ext(0->18446744073709551615) 00002000:00010000:1.0:1788197567.584311:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c741119180. 00000100:00100000:1.0:1788197567.584353:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:1.0:1788197567.584365:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755313536:12345-192.168.206.40@tcp:10:bash.0 00002000:00010000:1.0:1788197567.584806:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788197567.584811:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788197563 -> 1788197567 00002000:00010000:1.0:1788197567.584814:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788197561 -> 1788197561 00002000:00010000:1.0:1788197567.584816:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788197563 -> 1788197567 00002000:00010000:1.0:1788197567.584818:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788197567.584912:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755313536:12345-192.168.206.40@tcp:10:bash.0 Request processed in 547us (880us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788197567.584922:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00002000:00010000:1.0:1788197567.584927:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788197567.584929:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741119180 with x1875060755313536 ext(0->18446744073709551615) 00002000:00010000:1.0:1788197567.584934:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c741119180. 00000100:00100000:0.0:1788197567.600016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.600283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.600321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197567.600409:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755313920 00000100:00100000:3.0:1788197567.600418:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755313920 00000100:00100000:3.0:1788197567.600507:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00100000:3.0:1788197567.600518:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755313920:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197567.600596:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2360:x1875060755313920:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197567.600604:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00100000:1.0:1788197567.601058:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755313664 00000100:00100000:1.0:1788197567.601064:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755313664 00000100:00100000:1.0:1788197567.601121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 288 00000100:00100000:1.0:1788197567.601130:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755313664:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197567.601165:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755313664:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 36us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197567.601171:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 288 00000100:00080000:0.0:1788197567.603034:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197567.605627:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755313792 00000100:00100000:2.0:1788197567.605644:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755313792 00000100:00100000:2.0:1788197567.606647:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:2.0:1788197567.606663:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755313792:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197567.606781:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755313792:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 122us (6773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197567.606788:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00080000:0.0:1788197567.612066:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788197567.712015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.712074:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755314048 00000100:00100000:1.0:1788197567.712083:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755314048 00000100:00100000:1.0:1788197567.712155:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:1.0:1788197567.712165:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10494:x1875060755314048:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:1.0:1788197567.712232:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712247:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712257:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712273:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712280:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712286:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712492:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712502:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712509:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197567.712544:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712555:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712567:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712573:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712579:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfe00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.712583:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712591:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712602:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:1.0:1788197567.712605:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.712609:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712615:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712629:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712634:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712639:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712643:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.712652:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712658:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712666:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c704a46e00) 00010000:00010000:1.0:1788197567.712668:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.712671:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712676:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c292403065f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712711:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712717:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712722:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712726:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.712732:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712738:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712745:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:1.0:1788197567.712747:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.712755:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.712761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197567.713095:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10494:x1875060755314048:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 928us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197567.713104:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 91 00000100:00100000:3.0:1788197567.753095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.753214:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755314304 00000100:00100000:1.0:1788197567.753227:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755314304 00000100:00100000:1.0:1788197567.753295:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:1.0:1788197567.753310:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:10497:x1875060755314304:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197567.753336:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197567.753361:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403066d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d585e expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753431:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753446:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753459:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753479:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753487:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753518:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753887:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924030682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753897:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924030682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.753904:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924030682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197567.753914:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788197567.754045:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754054:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754061:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754067:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.754073:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754081:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754098:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:1.0:1788197567.754101:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.754116:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754124:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754142:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754149:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754155:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754160:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfe00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.754164:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754171:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754180:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c704a46e00) 00010000:00010000:1.0:1788197567.754183:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.754186:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754193:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403067b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754240:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403066d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d585e expref: 30 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754273:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924030682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d585e expref: 29 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.754280:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:1.0:1788197567.754282:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788197567.754285:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe400, rc 0) 00000100:00100000:1.0:1788197567.754348:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:10497:x1875060755314304:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1040us (1265us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788197567.754356:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:0.0:1788197567.760216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.760298:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755314432 00000100:00100000:1.0:1788197567.760309:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755314432 00000100:00100000:1.0:1788197567.760402:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:1.0:1788197567.760413:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:10497:x1875060755314432:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:1.0:1788197567.760476:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.760505:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.760515:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.760551:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.760567:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 29 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197567.760597:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776307456:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197567.760687:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788197567.763320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.763433:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776307456:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197567.763482:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197567.763677:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755314688 00000100:00100000:2.0:1788197567.763685:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755314688 00000100:00100000:2.0:1788197567.763762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1788197567.763773:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:5598:x1875060755314688:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788197567.764414:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:5598:x1875060755314688:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 640us (1100us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788197567.764441:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:3.0:1788197567.767467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.767636:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755314816 00000100:00100000:1.0:1788197567.767647:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755314816 00010000:00010000:1.0:1788197567.767685:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197567.767737:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1788197567.767747:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:2360:x1875060755314816:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197567.767762:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197567.767770:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.767783:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.767806:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5849 expref: 31 pid: 5843 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.767860:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:1.0:1788197567.767866:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.767894:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.767901:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.768092:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197567.768238:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:2360:x1875060755314816:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 491us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197567.768247:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00010000:00010000:3.0:1788197567.768309:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768327:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768357:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768365:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768372:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768378:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197567.768383:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768390:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768400:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:3.0:1788197567.768403:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788197567.768406:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.768412:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197567.768454:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:10497:x1875060755314432:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 8042us (8248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197567.768462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:3.0:1788197567.771416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197567.771517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755315072 00000100:00100000:2.0:1788197567.771527:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755315072 00000100:00100000:2.0:1788197567.771618:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:2.0:1788197567.771639:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:10497:x1875060755315072:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197567.772084:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10497:x1875060755315072:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 282us (503us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788197567.772093:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:0.0:1788197567.855886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.856025:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755315328 00000100:00100000:1.0:1788197567.856034:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755315328 00000100:00100000:1.0:1788197567.856092:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:1.0:1788197567.856102:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:10508:x1875060755315328:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:1.0:1788197567.856137:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197567.856156:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5865 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856227:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856241:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856253:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856268:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856290:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856296:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856552:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c29240306ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856562:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c29240306ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856570:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c29240306ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197567.856579:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788197567.856668:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856675:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856681:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856687:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfe00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.856691:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856707:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856729:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:1.0:1788197567.856732:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.856737:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856743:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c292403069e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856757:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856763:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856768:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856772:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.856775:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856780:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856788:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c704a46e00) 00010000:00010000:1.0:1788197567.856790:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.856793:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856798:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c29240306a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.856903:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5865 expref: 33 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.857265:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c29240306ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5865 expref: 32 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.857273:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:1.0:1788197567.857275:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197567.857278:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf000, rc 0) 00000100:00100000:1.0:1788197567.857692:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10508:x1875060755315328:12345-192.168.206.40@tcp:101:cat.0 Request processed in 1588us (1820us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788197567.857712:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:3.0:1788197567.864026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.864090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755315584 00000100:00100000:1.0:1788197567.864100:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755315584 00000100:00100000:1.0:1788197567.864159:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:1.0:1788197567.864172:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10508:x1875060755315584:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:1.0:1788197567.864791:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:10508:x1875060755315584:12345-192.168.206.40@tcp:35:cat.0 Request processed in 620us (773us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788197567.864800:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:3.0:1788197567.885382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.885476:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755315840 00000100:00100000:0.0:1788197567.885486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755315840 00000100:00100000:0.0:1788197567.885548:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:0.0:1788197567.885558:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:10509:x1875060755315840:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:0.0:1788197567.885610:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788197567.885636:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c29240306ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5865 expref: 33 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885657:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924030682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d585e expref: 32 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885685:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403064a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5850 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885695:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c7065f6800) 00010000:00010000:0.0:1788197567.885712:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197567.885732:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885743:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885751:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885766:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885773:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.885780:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886053:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886061:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886068:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788197567.886661:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788197567.886671:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364032847896ns, next at 365032845709ns, rc = 0 00010000:00010000:0.0:1788197567.886749:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886759:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886767:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886774:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886781:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886787:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886804:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788197567.886851:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197567.886857:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886863:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197567.886867:0:8526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886873:0:8526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886895:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c719ede000) 00010000:00010000:0.0:1788197567.886897:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788197567.886902:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886907:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.886917:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197567.886919:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197567.886921:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197567.887045:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887052:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887057:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887061:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197567.887064:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887069:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887075:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93c719ede000) 00010000:00010000:0.0:1788197567.887078:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788197567.887080:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887094:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887111:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887117:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887122:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887126:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197567.887128:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887133:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887140:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197567.887142:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197567.887145:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.887150:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788197567.887158:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000278c52b1 reply state 00000000b1ce897c transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197567.887166:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788197567.887243:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:10509:x1875060755315840:12345-192.168.206.40@tcp:36:rm.0 Request processed in 1684us (1867us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788197567.887252:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 95 00010000:00010000:1.0:1788197567.890293:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.890312:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.890319:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.890341:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.890345:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.890353:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.890370:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c719ede900) 00010000:00010000:1.0:1788197567.890372:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.890377:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.890383:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240306c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197567.950720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.951264:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755316096 00000100:00100000:0.0:1788197567.951274:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755316096 00000100:00100000:0.0:1788197567.951331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:0.0:1788197567.951341:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:10515:x1875060755316096:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197567.951364:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197567.951383:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d586c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.951512:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.951526:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.951537:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.951551:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.951557:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197567.951563:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788197567.957404:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788197567.959899:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.959923:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.959937:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960004:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960011:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960036:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960041:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197567.960045:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960052:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960064:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:1.0:1788197567.960067:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197567.960071:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960076:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240306dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197567.960093:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000690d0c4b reply state 00000000fd287fc6 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197567.960102:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788197567.960141:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240306d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960156:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.960164:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46e00) 00010000:00010000:1.0:1788197567.960166:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197567.960175:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe200, rc 0) 00000100:00100000:1.0:1788197567.960253:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:10515:x1875060755316096:12345-192.168.206.40@tcp:101:bash.0 Request processed in 8912us (9551us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788197567.960262:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 96 00010000:00010000:3.0:1788197567.962042:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.962061:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.962069:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.962074:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197567.962078:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.962084:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.962100:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c719ede000) 00010000:00010000:3.0:1788197567.962103:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197567.962109:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197567.962115:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240306e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197567.964343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197567.966251:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755316224 00000100:00100000:1.0:1788197567.966267:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755316224 00000100:00100000:1.0:1788197567.966329:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:1.0:1788197567.966339:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755316224:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1788197567.966360:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197567.966398:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5873 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788197567.966429:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788197567.966451:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1788197567.966457:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197567.966467:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.966484:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197567.966497:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe800, rc 0) 00000100:00100000:1.0:1788197567.966568:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755316224:12345-192.168.206.40@tcp:101:bash.0 Request processed in 230us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197567.966576:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:0.0:1788197567.969321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197567.969427:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755316352 00000100:00100000:2.0:1788197567.969437:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755316352 00000100:00100000:2.0:1788197567.969497:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:2.0:1788197567.969507:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:10515:x1875060755316352:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197567.969525:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197567.969544:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d587a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.969573:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.969581:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197567.969585:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197567.969589:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.969644:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.969658:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 7 pid: 6699 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197567.969671:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776307584:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197567.969773:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788197567.972039:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d27800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776307584:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197567.972075:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.972093:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d600, rc 0) 00000100:00100000:2.0:1788197567.972152:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:10515:x1875060755316352:12345-192.168.206.40@tcp:101:bash.0 Request processed in 2645us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197567.972161:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:3.0:1788197567.973940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197567.974029:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755316480 00000100:00100000:2.0:1788197567.974039:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755316480 00010000:00010000:2.0:1788197567.974076:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 7 pid: 6699 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197567.974125:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:2.0:1788197567.974135:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2358:x1875060755316480:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197567.974169:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197567.974195:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 7 pid: 6699 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.974209:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 7 pid: 6699 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.974232:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7481d6e/0x167e6c29240306f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5873 expref: 7 pid: 6699 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.974250:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197567.974254:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197567.974262:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.974272:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197567.974310:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197567.974323:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875060776307712:192.168.206.40@tcp:105: 00000100:00100000:2.0:1788197567.974413:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788197567.977371:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1875060776307712:192.168.206.40@tcp:105: 00010000:00010000:2.0:1788197567.977401:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197567.977490:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755316480:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 3344us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197567.977503:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1788197567.979938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197567.980150:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755316736 00000100:00100000:0.0:1788197567.980165:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755316736 00000100:00100000:0.0:1788197567.980218:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1788197567.980227:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:10515:x1875060755316736:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:0.0:1788197567.980568:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:10515:x1875060755316736:12345-192.168.206.40@tcp:35:bash.0 Request processed in 340us (638us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788197567.980576:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00010000:00010000:3.0:1788197568.110113:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197568.118125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.118263:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755316864 00000100:00100000:0.0:1788197568.118272:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755316864 00000100:00100000:0.0:1788197568.118330:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:0.0:1788197568.118341:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:10531:x1875060755316864:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197568.118364:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.118381:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5881 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.118438:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403070e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.118451:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403070e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.118461:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403070e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.118508:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788197568.118513:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197568.118529:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403070e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.118552:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5881 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.118588:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403070e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5881 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.118597:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197568.118600:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197568.118603:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030c00, rc 0) 00000100:00100000:0.0:1788197568.118665:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:10531:x1875060755316864:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 325us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197568.118673:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:3.0:1788197568.123363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.123451:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755317120 00000100:00100000:0.0:1788197568.123463:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755317120 00000100:00100000:0.0:1788197568.123537:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:0.0:1788197568.123548:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:10531:x1875060755317120:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197568.123569:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.123590:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030715 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5888 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.123730:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403071c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.123745:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403071c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.123755:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403071c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.123766:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788197568.123957:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c2924030715 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5888 expref: 38 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.123978:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403071c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5888 expref: 37 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.123987:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46e00) 00010000:00010000:0.0:1788197568.123990:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197568.123994:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:0.0:1788197568.124058:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:10531:x1875060755317120:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 511us (703us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788197568.124065:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:2.0:1788197568.127597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197568.127645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.127734:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755317504 00000100:00100000:1.0:1788197568.127753:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755317504 00000100:00100000:1.0:1788197568.127882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:1.0:1788197568.127893:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:2360:x1875060755317504:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197568.127915:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197568.127941:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403071c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5888 expref: 37 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.127961:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46e00) 00010000:00010000:1.0:1788197568.127966:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197568.128011:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:2360:x1875060755317504:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 120us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197568.128018:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:0.0:1788197568.129882:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755317376 00000100:00100000:0.0:1788197568.129896:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755317376 00000100:00100000:0.0:1788197568.130031:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:0.0:1788197568.130043:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:10531:x1875060755317376:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197568.130064:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.130218:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403072a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d588f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.130330:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030731 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.130346:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.130384:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.130414:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788197568.130531:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403072a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d588f expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.131391:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d588f expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.131402:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46e00) 00010000:00010000:0.0:1788197568.131405:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788197568.131409:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031a00, rc 0) 00000100:00100000:0.0:1788197568.131554:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:10531:x1875060755317376:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1501us (3895us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788197568.131564:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:2.0:1788197568.140328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.140432:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755317632 00000100:00100000:1.0:1788197568.140442:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755317632 00000100:00100000:1.0:1788197568.140501:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:1.0:1788197568.140511:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755317632:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:1.0:1788197568.140560:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.140579:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.140587:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197568.140591:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197568.140595:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.140629:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.140660:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 6 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197568.140677:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1875060776307840:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197568.141138:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197568.143344:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1875060776307840:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197568.143370:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197568.144614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197568.145431:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755317760 00000100:00100000:3.0:1788197568.145446:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755317760 00002000:00100000:3.0:1788197568.145493:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93c736d24a80 x1875060755317760/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:464/0 lens 504/0 e 0 to 0 dl 1788197579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197568.145504:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736d24a80 with x1875060755317760 ext(0->8) 00010000:00010000:3.0:1788197568.145512:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 7 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.145526:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 7 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197568.145533:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c736d24a80 00000100:00100000:3.0:1788197568.145657:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:3.0:1788197568.145668:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755317760:12345-192.168.206.40@tcp:4:lfs.0 00000100:00100000:3.0:1788197568.146233:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755317760:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 564us (1622us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788197568.146241:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00002000:00100000:3.0:1788197568.146249:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93c736d24a80 x1875060755317760/t4294967302(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:464/0 lens 504/448 e 0 to 0 dl 1788197579 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197568.146256:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736d24a80 with x1875060755317760 ext(0->8) 00010000:00010000:3.0:1788197568.146262:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 9 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.146285:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 9 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197568.146292:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c736d24a80 00000100:00100000:0.0:1788197568.151289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.151388:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755317888 00000100:00100000:1.0:1788197568.151397:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755317888 00010000:00010000:1.0:1788197568.151437:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 9 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197568.151482:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:1.0:1788197568.151492:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2358:x1875060755317888:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197568.151506:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788197568.151527:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788197568.151531:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788197567 00002000:00010000:1.0:1788197568.151535:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788197567 00002000:00010000:1.0:1788197568.151538:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788197567 00010000:00010000:1.0:1788197568.151544:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 9 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.151589:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 9 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.151621:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924030700 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d587a expref: 9 pid: 6698 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.151637:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197568.151642:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197568.151647:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.151658:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.151707:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197568.151746:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.151759:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197568.151762:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2358:x1875060755317888:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 271us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197568.151778:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00010000:00010000:3.0:1788197568.151796:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.151806:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.151814:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.151847:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfe00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197568.151851:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.151861:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.151890:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.151897:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086cd992e/0x167e6c292403073f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197568.152024:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755317632:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 11513us (11795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197568.152032:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:0.0:1788197568.157550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.157669:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755318144 00000100:00100000:1.0:1788197568.157689:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755318144 00000100:00100000:1.0:1788197568.157756:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:1.0:1788197568.157766:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7048c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:10531:x1875060755318144:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:1.0:1788197568.157851:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d588f expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788197568.158094:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788197568.158139:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788197568.158438:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788197568.158492:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.158507:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.158516:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.158553:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.158568:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 42 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197568.158582:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776307968:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197568.158679:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197568.166160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197568.166393:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755318272 00000100:00100000:2.0:1788197568.166403:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755318272 00010000:00010000:2.0:1788197568.166463:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 43 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197568.166519:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1788197568.166531:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+43:2360:x1875060755318272:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197568.166547:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197568.166556:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 43 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.166571:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 43 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.166614:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46e00) 00010000:00010000:2.0:1788197568.166621:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.166631:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.166639:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.166676:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197568.166750:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+43:2360:x1875060755318272:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 221us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197568.166758:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00010000:00010000:1.0:1788197568.167819:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240306eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d586c expref: 42 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197568.168371:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776307968:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197568.168398:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.168427:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.168433:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788197568.168578:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788197568.171166:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788197568.171360:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776308096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788197568.171439:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197568.171478:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197568.172374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776308096 00000100:00100000:2.0:1788197568.172386:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776308096 00000100:00100000:2.0:1788197568.172454:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788197568.172465:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776308096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788197568.172567:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776308096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 104us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197568.172574:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788197568.173165:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197568.174591:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788197568.174602:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788197568.174625:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c709108e00, transno 4294967301 00000100:00100000:1.0:1788197568.174719:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776308096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788197568.175245:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788197568.175334:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776308224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788197568.175402:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197568.175434:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197568.175896:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776308224 00000100:00100000:2.0:1788197568.175905:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776308224 00000100:00100000:2.0:1788197568.175962:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197568.175972:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776308224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788197568.176206:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875060776308224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 233us (802us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788197568.176215:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788197568.178886:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776308224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788197568.178978:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788197568.179038:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.179049:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.179057:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.179083:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197568.179087:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.179095:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.179111:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46e00) 00010000:00010000:0.0:1788197568.179114:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788197568.179118:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.179125:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030746 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788197568.179914:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788197568.180043:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788197568.180052:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364326228882ns, next at 365326226945ns, rc = 0 00000001:00080000:0.0:1788197568.180058:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788197568.180093:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46e00) 00010000:00010000:0.0:1788197568.180097:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788197568.180104:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030731 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d588f expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197568.180210:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7048c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+45:10531:x1875060755318144:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 22444us (22674us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788197568.181414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000020:00080000:0.0:1788197568.181419:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788197568.185173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.185379:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755318400 00000100:00100000:1.0:1788197568.185392:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755318400 00000100:00100000:1.0:1788197568.185685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:1.0:1788197568.185706:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+45:10531:x1875060755318400:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197568.185733:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197568.185769:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403074d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5896 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.185892:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403074d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5896 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.185906:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403074d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5896 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.185927:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197568.185931:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197568.185936:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe200, rc 0) 00000100:00100000:1.0:1788197568.186008:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+46:10531:x1875060755318400:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 313us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197568.188062:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:2.0:1788197568.190393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.191520:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755318656 00000100:00100000:0.0:1788197568.191532:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755318656 00000100:00100000:0.0:1788197568.191587:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:0.0:1788197568.191597:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+46:10531:x1875060755318656:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:0.0:1788197568.191907:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+47:10531:x1875060755318656:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 310us (1525us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788197568.191915:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:3.0:1788197568.333050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.336452:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755318784 00000100:00100000:1.0:1788197568.336468:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755318784 00000100:00100000:2.0:1788197568.336663:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:2.0:1788197568.336676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+47:10541:x1875060755318784:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:2.0:1788197568.336768:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336784:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336811:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336841:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336857:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336864:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336962:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336970:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.336977:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197568.337015:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337026:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337033:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337040:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337056:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197568.337060:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337068:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337088:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197568.337091:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197568.337095:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337101:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337113:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337119:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337125:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337130:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197568.337132:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337138:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337153:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4800) 00010000:00010000:2.0:1788197568.337156:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197568.337158:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337164:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403075b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337178:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337183:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337189:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337194:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197568.337197:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337202:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337208:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:2.0:1788197568.337210:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197568.337213:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.337218:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197568.337302:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+47:10541:x1875060755318784:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 627us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197568.337310:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:2.0:1788197568.381266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.385832:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755319040 00000100:00100000:0.0:1788197568.385849:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755319040 00000100:00100000:0.0:1788197568.386214:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:0.0:1788197568.386227:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+47:10544:x1875060755319040:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197568.386250:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.386496:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030769 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d589d expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386586:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386603:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386616:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386633:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386640:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386666:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386816:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403077e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386850:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.386858:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.386869:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788197568.387197:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387207:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387214:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387220:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197568.387225:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387233:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387249:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197568.387252:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197568.387264:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387271:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387464:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387471:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387477:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387483:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197568.387486:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387492:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387502:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c719ede300) 00010000:00010000:0.0:1788197568.387505:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197568.387508:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387512:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387560:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030769 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d589d expref: 50 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387591:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403077e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d589d expref: 49 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.387599:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.387601:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197568.387603:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030800, rc 0) 00000100:00100000:0.0:1788197568.387775:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+49:10544:x1875060755319040:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1550us (6518us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788197568.387785:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:3.0:1788197568.394147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.394219:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755319168 00000100:00100000:0.0:1788197568.394227:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755319168 00000100:00100000:0.0:1788197568.394279:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:0.0:1788197568.394289:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+49:10544:x1875060755319168:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:0.0:1788197568.394348:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394364:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394375:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394399:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394406:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394429:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394435:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197568.394439:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394446:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394458:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.394462:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197568.394466:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.394472:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403078c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197568.394558:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+49:10544:x1875060755319168:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 270us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197568.394566:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:3.0:1788197568.397273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.397517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755319424 00000100:00100000:0.0:1788197568.397526:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755319424 00000100:00100000:0.0:1788197568.397585:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:0.0:1788197568.397595:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+49:10544:x1875060755319424:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:0.0:1788197568.397842:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+50:10544:x1875060755319424:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 230us (561us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788197568.397850:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:3.0:1788197568.499618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.499864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755319680 00000100:00100000:1.0:1788197568.499874:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755319680 00000100:00100000:0.0:1788197568.500191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:0.0:1788197568.500204:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+50:10554:x1875060755319680:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197568.500229:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.500232:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788197568.500257:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403070e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5881 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.500273:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197568.500289:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197568.500302:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030793 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.500386:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.500399:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.500408:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.500417:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788197568.500526:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030793 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.500540:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.500548:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.500564:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197568.500567:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031a00, rc 0) 00000100:00100000:0.0:1788197568.500632:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:10554:x1875060755319680:12345-192.168.206.40@tcp:101:bash.0 Request processed in 431us (1022us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788197568.500640:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:3.0:1788197568.504775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197568.504848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.504979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755320064 00000100:00100000:0.0:1788197568.504989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755320064 00000100:00100000:0.0:1788197568.505037:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:0.0:1788197568.505047:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:10554:x1875060755320064:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:0.0:1788197568.505099:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197568.505123:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403077e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d589d expref: 51 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.505140:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.505145:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197568.505330:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.505343:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.505351:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.505380:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.505393:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 51 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197568.505424:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776308352:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197568.505508:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add000 going to sleep for 11 seconds 00000100:00100000:1.0:1788197568.505854:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755319808 00000100:00100000:1.0:1788197568.505859:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755319808 00010000:00010000:1.0:1788197568.505891:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 52 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197568.505921:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:1.0:1788197568.505928:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:2360:x1875060755319808:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197568.505938:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197568.505943:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 52 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.505967:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 52 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.505980:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197568.505985:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.505993:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.505999:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.506011:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197568.506049:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:2360:x1875060755319808:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 121us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197568.506057:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00010000:00010000:0.0:1788197568.508222:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.40@tcp) returned -22 from blocking AST (req@00000000e1701a2e x1875060776308352) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 51 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.508245:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c292403079a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58a4 expref: 51 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197568.508262:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776308352:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197568.508292:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.508300:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.508308:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.508314:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788197568.508431:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788197568.508479:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046addb3b reply state 00000000b034bda0 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197568.508488:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788197568.508617:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:10554:x1875060755320064:12345-192.168.206.40@tcp:36:bash.0 Request processed in 3570us (3849us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788197568.508643:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 105 00000020:00080000:0.0:1788197568.508650:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788197568.511096:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.511113:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.511121:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.511127:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197568.511133:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.511141:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.511156:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.511159:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197568.511163:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.511168:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197568.511922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.512001:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755320192 00000100:00100000:0.0:1788197568.512011:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755320192 00000100:00100000:0.0:1788197568.512066:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00100000:0.0:1788197568.512076:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:10554:x1875060755320192:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197568.512116:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.512137:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240307af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.512220:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.512234:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.512249:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.512283:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788197568.512287:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197568.512305:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.512330:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240307af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.512345:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.512354:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.512356:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197568.512360:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030c00, rc 0) 00000100:00100000:0.0:1788197568.512426:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:10554:x1875060755320192:12345-192.168.206.40@tcp:101:bash.0 Request processed in 350us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197568.512434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00100000:3.0:1788197568.523449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.524467:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755320448 00000100:00100000:0.0:1788197568.524606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755320448 00000100:00100000:1.0:1788197568.524744:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:1.0:1788197568.524756:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:10554:x1875060755320448:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:1.0:1788197568.525004:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+53:10554:x1875060755320448:12345-192.168.206.40@tcp:35:bash.0 Request processed in 249us (1563us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788197568.525011:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:2.0:1788197568.608557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197568.608785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755320576 00000100:00100000:3.0:1788197568.608795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755320576 00000100:00100000:3.0:1788197568.608885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 107 00000100:00100000:3.0:1788197568.608896:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+53:10560:x1875060755320576:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197568.608925:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197568.608949:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240307bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58b2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.609044:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240307c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.609058:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240307c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.609069:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240307c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197568.609100:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788197568.609103:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197568.609117:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240307c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.609139:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240307bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b2 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.609158:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240307c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b2 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.609168:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197568.609170:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197568.609173:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7e00, rc 0) 00000100:00100000:3.0:1788197568.609237:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:10560:x1875060755320576:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 343us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197568.609243:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 107 00000100:00100000:3.0:1788197568.612003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.612121:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755320704 00000100:00100000:0.0:1788197568.612130:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755320704 00000100:00100000:0.0:1788197568.612186:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 108 00000100:00100000:0.0:1788197568.612197:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:10560:x1875060755320704:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197568.612216:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.612239:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240307cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612317:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612331:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612342:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612357:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612364:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612370:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612460:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612468:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612488:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.612522:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788197568.612525:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197568.612543:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612557:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612565:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612571:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612578:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612583:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197568.612587:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612594:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612607:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197568.612611:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197568.612615:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612632:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c29240307d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612648:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612654:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612660:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612665:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197568.612668:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612674:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612683:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c719ede300) 00010000:00010000:0.0:1788197568.612685:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197568.612687:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612693:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c29240307d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612732:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240307cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612744:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.612757:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.612759:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197568.612762:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030800, rc 0) 00000100:00100000:1.0:1788197568.612903:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10560:x1875060755320704:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 706us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197568.612911:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 108 00000100:00100000:1.0:1788197568.621427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197568.621938:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755320960 00000100:00100000:3.0:1788197568.621954:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755320960 00000100:00100000:3.0:1788197568.622009:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 109 00000100:00100000:3.0:1788197568.622020:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10560:x1875060755320960:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197568.622038:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197568.622057:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240307e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58c0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.622149:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.622162:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.622170:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.622177:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.622208:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.622220:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197568.622232:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776308480:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197568.622339:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197568.622360:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197568.622368:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776308608:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197568.622394:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2db0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197568.623667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:2.0:1788197568.625198:0:5842:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.40@tcp) returned -22 from blocking AST (req@0000000023a214f9 x1875060776308480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.625221:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.625249:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240307e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b9 expref: 56 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197568.625269:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776308480:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197568.625282:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776308608:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197568.625311:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:2.0:1788197568.625316:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.625325:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.625335:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197568.626407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.627363:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755321088 00000100:00100000:0.0:1788197568.627378:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755321088 00000100:00100000:0.0:1788197568.627445:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755321216 00000100:00100000:0.0:1788197568.627449:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755321216 00010000:00010000:0.0:1788197568.627466:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197568.627509:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:0.0:1788197568.627519:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:2360:x1875060755321216:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197568.627534:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197568.627541:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.627553:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.627573:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c29240307b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ab expref: 57 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.627587:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.627593:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.627602:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.627621:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.627651:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197568.627673:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:1.0:1788197568.627687:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:2358:x1875060755321088:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197568.627709:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197568.627713:0:5826:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 167e6c29240307e0) 00010000:00010000:1.0:1788197568.627716:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197568.627722:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:2360:x1875060755321216:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 203us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197568.627731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:1.0:1788197568.627745:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:2358:x1875060755321088:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 61us (4081us total) trans 0 rc 116/116 00000100:00100000:1.0:1788197568.627752:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00010000:00010000:0.0:1788197568.627762:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.627771:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197568.627790:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788197568.628137:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c29240307e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.628152:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.628160:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.628163:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788197568.628165:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6200, rc 0) 00000100:00100000:0.0:1788197568.628192:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10560:x1875060755320960:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 6174us (6774us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788197568.628199:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 109 00000100:00100000:0.0:1788197568.633064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197568.633158:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755321472 00000100:00100000:2.0:1788197568.633168:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755321472 00000100:00100000:2.0:1788197568.633263:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1788197568.633273:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10560:x1875060755321472:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:2.0:1788197568.633287:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197568.633310:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403074d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5896 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197568.633327:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:2.0:1788197568.633332:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197568.633387:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:10560:x1875060755321472:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197568.633394:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1788197568.636317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197568.636399:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755321600 00000100:00100000:1.0:1788197568.636409:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755321600 00000100:00100000:1.0:1788197568.636466:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:1.0:1788197568.636476:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:10560:x1875060755321600:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:1.0:1788197568.636585:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.636600:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197568.636611:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788197568.637228:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788197568.637578:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:10560:x1875060755321600:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 1098us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197568.637587:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:3.0:1788197568.640267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197568.640522:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755321728 00000100:00100000:0.0:1788197568.640550:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755321728 00000100:00100000:0.0:1788197568.640616:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 111 00000100:00100000:0.0:1788197568.640627:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:10560:x1875060755321728:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197568.640653:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197568.640680:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58c7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.640755:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.640767:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.640785:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.640798:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.640812:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197568.640815:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788197568.640820:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197568.640857:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031a00, rc 0) 00000100:00100000:0.0:1788197568.640927:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10560:x1875060755321728:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 301us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197568.640934:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 111 00010000:00010000:3.0:1788197569.134671:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197569.390218:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776308736:0@lo:400:kworker.0 00000100:00100000:0.0:1788197569.390300:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197569.390357:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776309248:0@lo:400:kworker.0 00000100:00100000:0.0:1788197569.390396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197569.390420:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788197569.390426:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776308864:0@lo:400:kworker.0 00000100:00100000:0.0:1788197569.390459:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197569.390476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776309376:0@lo:400:kworker.0 00000100:00100000:0.0:1788197569.390499:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197569.390579:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776308736 00000100:00100000:2.0:1788197569.390588:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776308736 00000100:00100000:2.0:1788197569.390658:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788197569.390670:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776308736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197569.390678:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776309120:0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.390750:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c705637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776308736:12345-0@lo:400:kworker.0 Request processed in 82us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.390758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788197569.390799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197569.390811:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776308736:0@lo:400:kworker.0 00000100:00100000:3.0:1788197569.390857:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197569.390866:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776308992:0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.390889:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776309248 00000100:00100000:2.0:1788197569.390894:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776309248 00000100:00100000:3.0:1788197569.390897:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788197569.390936:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197569.390938:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776309376 00000100:00100000:3.0:1788197569.390943:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776309376 00000100:00100000:2.0:1788197569.390969:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776308864 00000100:00100000:2.0:1788197569.390975:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776308864 00000100:00100000:3.0:1788197569.390991:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776309120 00000100:00100000:2.0:1788197569.390995:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776308992 00000100:00100000:3.0:1788197569.390997:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776309120 00000100:00100000:2.0:1788197569.391000:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776308992 00000100:00100000:2.0:1788197569.391034:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788197569.391045:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788197569.391045:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776309248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197569.391059:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776309376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.391097:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776309248:12345-0@lo:400:kworker.0 Request processed in 56us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.391106:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788197569.391111:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776309376:12345-0@lo:400:kworker.0 Request processed in 55us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197569.391119:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788197569.391141:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788197569.391144:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776309376:0@lo:400:kworker.0 00000100:00100000:3.0:1788197569.391151:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776309120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.391159:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776309248:0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.391191:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788197569.391196:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776309120:12345-0@lo:400:kworker.0 Request processed in 46us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.391202:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776308864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.391241:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776308864:12345-0@lo:400:kworker.0 Request processed in 42us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.391246:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788197569.391270:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776308864:0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.391301:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788197569.391307:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776308992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.391337:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776308992:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.391343:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1788197569.391368:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788197569.391372:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788197569.391403:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776308992:0@lo:400:kworker.0 00000100:00100000:2.0:1788197569.391425:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776309120:0@lo:400:kworker.0 00000100:00100000:3.0:1788197569.392018:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000040:00080000:1.0:1788197569.582078:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788197569.582087:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788197569.582126:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788197569.582146:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788197569.582278:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737006300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776309504:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788197569.582379:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788197569.589019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197569.589143:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737006300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776309504:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788197569.589505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755321856 00000100:00100000:2.0:1788197569.589513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755321856 00000100:00100000:2.0:1788197569.589594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 112 00000100:00100000:2.0:1788197569.589604:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10561:x1875060755321856:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788197569.589638:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788197569.589750:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10561:x1875060755321856:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 147us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.589759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 112 00000100:00080000:0.0:1788197569.590039:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197569.598018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.598484:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755321984 00000100:00100000:2.0:1788197569.598494:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755321984 00000100:00100000:2.0:1788197569.598565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:2.0:1788197569.598577:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10561:x1875060755321984:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788197569.598664:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598683:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598704:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598764:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598772:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598802:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598864:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598874:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598880:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197569.598931:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788197569.598935:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197569.598948:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598958:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598966:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598972:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598977:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197569.598982:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.598988:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599007:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:2.0:1788197569.599010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197569.599015:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599021:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c292403080a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599036:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599042:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599048:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599054:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197569.599056:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599063:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599070:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93c7028a4800) 00010000:00010000:2.0:1788197569.599073:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197569.599075:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599081:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030811 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599122:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599128:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599133:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599138:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197569.599141:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599147:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599154:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:2.0:1788197569.599156:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197569.599158:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.599164:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.599239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10561:x1875060755321984:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 663us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.599247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 113 00000100:00100000:1.0:1788197569.607471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.607623:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755322240 00000100:00100000:2.0:1788197569.607634:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755322240 00000100:00100000:2.0:1788197569.607713:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:2.0:1788197569.607741:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:10561:x1875060755322240:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197569.607765:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197569.607789:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c292403081f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58ce expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.607940:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.607957:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.607969:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197569.607981:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788197569.608100:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608109:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608116:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608122:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197569.608127:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608135:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608149:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:2.0:1788197569.608160:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788197569.608166:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608172:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608215:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c292403081f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ce expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608231:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:2.0:1788197569.608234:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197569.608238:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c292403081f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ce expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.608248:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c400, rc 0) 00000100:00100000:2.0:1788197569.608307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:10561:x1875060755322240:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 568us (850us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788197569.608315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 114 00000100:00100000:3.0:1788197569.618648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.618886:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755322368 00000100:00100000:2.0:1788197569.618901:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755322368 00000100:00100000:2.0:1788197569.618975:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:2.0:1788197569.618986:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:10561:x1875060755322368:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788197569.619052:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788197569.619176:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:10561:x1875060755322368:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 191us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.619184:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 115 00000100:00100000:0.0:1788197569.623320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197569.623367:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755322624 00000100:00100000:3.0:1788197569.623378:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755322624 00000100:00100000:3.0:1788197569.623442:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:3.0:1788197569.623454:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:10561:x1875060755322624:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788197569.623487:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197569.623490:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788197569.623519:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c29240307c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58b2 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.623538:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197569.623543:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197569.623558:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030834 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58d5 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788197569.625890:0:5871:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788197569.627012:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403083b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.627040:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403083b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.627052:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403083b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.627116:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030834 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58d5 expref: 58 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.627150:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403083b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58d5 expref: 57 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.627159:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c7065f6400) 00010000:00010000:3.0:1788197569.627162:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788197569.627165:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7c00, rc 0) 00000100:00100000:3.0:1788197569.627243:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:10561:x1875060755322624:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 3791us (3933us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788197569.627251:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 116 00000100:00100000:3.0:1788197569.630991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.632434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755322880 00000100:00100000:2.0:1788197569.632460:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755322880 00000100:00100000:2.0:1788197569.632530:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:2.0:1788197569.632540:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:10561:x1875060755322880:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788197569.632602:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197569.632630:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c292403083b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58d5 expref: 57 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632650:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c7065f6400) 00010000:00010000:2.0:1788197569.632660:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197569.632704:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632717:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632727:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632753:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632761:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632768:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632863:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632870:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632883:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632888:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197569.632892:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632911:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632920:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:2.0:1788197569.632923:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197569.632926:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632932:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030849 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632943:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632949:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632955:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632960:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197569.632963:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632983:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.632992:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd2589db8 (ffff93c7028a4800) 00010000:00010000:2.0:1788197569.632994:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197569.632997:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.633002:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030850 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd2589db8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.633089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:10561:x1875060755322880:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 550us (2108us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788197569.633097:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 117 00000100:00100000:2.0:1788197569.636940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197569.637139:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755323008 00000100:00100000:0.0:1788197569.637149:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755323008 00000100:00100000:0.0:1788197569.637220:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:0.0:1788197569.637231:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:10561:x1875060755323008:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197569.637253:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197569.637276:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030857 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58dc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.637311:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.637324:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.637336:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.637452:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.637469:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.637476:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:0.0:1788197569.637479:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788197569.637483:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:0.0:1788197569.637536:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:10561:x1875060755323008:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 306us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197569.637543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 118 00000100:00100000:3.0:1788197569.641939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.642037:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755323264 00000100:00100000:2.0:1788197569.642048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755323264 00000100:00100000:2.0:1788197569.642112:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 119 00000100:00100000:2.0:1788197569.642124:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:10561:x1875060755323264:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788197569.642221:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.642239:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.642250:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197569.642488:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788197569.642512:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365788689270ns, next at 366788687224ns, rc = 0 00000004:00010000:2.0:1788197569.642597:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006237cf02 reply state 000000008a911387 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.642606:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197569.642716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:10561:x1875060755323264:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 591us (783us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788197569.642723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 119 00010000:00010000:3.0:1788197569.647732:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.647747:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.647754:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.647760:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197569.647765:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.647773:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.647791:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:3.0:1788197569.647810:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788197569.647816:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.647860:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030865 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197569.650946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197569.651179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755323392 00000100:00100000:0.0:1788197569.651189:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755323392 00000100:00100000:0.0:1788197569.651255:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:0.0:1788197569.651266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:10561:x1875060755323392:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197569.651288:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197569.651307:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.651364:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.651378:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.651420:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:0.0:1788197569.651424:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788197569.651427:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031e00, rc 0) 00000100:00100000:0.0:1788197569.651502:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:10561:x1875060755323392:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 237us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197569.651510:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 120 00000100:00100000:1.0:1788197569.656155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.656434:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755323520 00000100:00100000:2.0:1788197569.656443:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755323520 00000100:00100000:2.0:1788197569.656525:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:2.0:1788197569.656539:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755323520:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788197569.656878:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2360:x1875060755323520:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 339us (731us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788197569.656885:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00080000:0.0:1788197569.657528:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788197569.660399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197569.660500:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755323776 00000100:00100000:1.0:1788197569.660510:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755323776 00000100:00100000:1.0:1788197569.660570:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:1.0:1788197569.660580:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:10561:x1875060755323776:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788197569.660872:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:10561:x1875060755323776:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 291us (482us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788197569.660881:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:1.0:1788197569.663562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.663657:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755324032 00000100:00100000:2.0:1788197569.663667:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755324032 00000100:00100000:2.0:1788197569.663802:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:2.0:1788197569.663813:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:10561:x1875060755324032:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788197569.663966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:10561:x1875060755324032:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 155us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.663974:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 121 00000100:00100000:3.0:1788197569.668345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197569.668519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755324160 00000100:00100000:0.0:1788197569.668529:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755324160 00000100:00100000:0.0:1788197569.668593:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:0.0:1788197569.668603:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:10561:x1875060755324160:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197569.668624:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197569.668647:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58ea expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.668765:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403087a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.668781:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403087a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.668793:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403087a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197569.668871:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197569.668890:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403087a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.668942:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ea expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.668962:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403087a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ea expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.668971:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:0.0:1788197569.668974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788197569.668978:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030c00, rc 0) 00000100:00100000:0.0:1788197569.669029:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:10561:x1875060755324160:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 428us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197569.669037:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:3.0:1788197569.673964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197569.674133:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755324288 00000100:00100000:1.0:1788197569.674146:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755324288 00000100:00100000:3.0:1788197569.674308:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:3.0:1788197569.674320:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755324288:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788197569.674340:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197569.674362:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58f1 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197569.674389:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95bac1, blocks: 0x1 00010000:00010000:3.0:1788197569.674410:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1788197569.674414:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197569.674425:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.674446:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.674460:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7e00, rc 0) 00000100:00100000:3.0:1788197569.674577:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2359:x1875060755324288:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 258us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197569.674599:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:1.0:1788197569.682025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.682811:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755324544 00000100:00100000:2.0:1788197569.682851:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755324544 00000100:00100000:2.0:1788197569.682909:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00100000:2.0:1788197569.682919:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:10561:x1875060755324544:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788197569.683059:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:10561:x1875060755324544:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 141us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.683067:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 123 00000100:00100000:0.0:1788197569.686348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.686504:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755324672 00000100:00100000:2.0:1788197569.686516:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755324672 00000100:00100000:2.0:1788197569.686571:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1788197569.686581:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:10561:x1875060755324672:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197569.686598:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197569.686616:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58f8 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.686658:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.686667:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197569.686671:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197569.686677:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.686727:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.686741:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 11 pid: 6696 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.686756:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875060776309632:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197569.686978:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788197569.696138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.696399:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875060776309632:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197569.696437:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.696458:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d800, rc 0) 00000100:00100000:2.0:1788197569.696526:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:10561:x1875060755324672:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 9945us (10187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.696535:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:0.0:1788197569.700309:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755324800 00000100:00100000:0.0:1788197569.700325:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755324800 00010000:00010000:0.0:1788197569.700379:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 11 pid: 6696 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.700489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:0.0:1788197569.700499:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:2359:x1875060755324800:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197569.700514:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197569.700537:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 11 pid: 6696 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.700551:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 11 pid: 6696 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.700589:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240c7091/0x167e6c2924030881 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f1 expref: 11 pid: 6696 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.700606:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197569.700610:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197569.700617:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.700627:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.700664:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.700677:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875060776309760:192.168.206.40@tcp:105: 00000100:00100000:0.0:1788197569.700769:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add540 going to sleep for 11 seconds 00000100:00100000:0.0:1788197569.703929:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875060776309760:192.168.206.40@tcp:105: 00010000:00010000:0.0:1788197569.703954:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197569.704010:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2359:x1875060755324800:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 3511us (7885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197569.704020:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:1.0:1788197569.708654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197569.708763:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755324928 00000100:00100000:3.0:1788197569.708773:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755324928 00002000:00100000:3.0:1788197569.708865:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93c737006a00 x1875060755324928/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:465/0 lens 504/0 e 0 to 0 dl 1788197580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197569.708876:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c737006a00 with x1875060755324928 ext(0->12) 00002000:00010000:3.0:1788197569.708882:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c737006a00 00000100:00100000:3.0:1788197569.708921:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:3.0:1788197569.708931:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2359:x1875060755324928:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788197569.709333:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:2359:x1875060755324928:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 402us (689us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788197569.709340:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00002000:00100000:3.0:1788197569.709347:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93c737006a00 x1875060755324928/t4294967308(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:465/0 lens 504/448 e 0 to 0 dl 1788197580 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197569.709354:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c737006a00 with x1875060755324928 ext(0->12) 00002000:00010000:3.0:1788197569.709358:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c737006a00 00000100:00100000:3.0:1788197569.712026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197569.712125:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755325056 00000100:00100000:0.0:1788197569.712135:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755325056 00000100:00100000:0.0:1788197569.712195:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:0.0:1788197569.712219:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:10561:x1875060755325056:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788197569.775120:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:2.0:1788197569.775151:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788197569.775173:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788197569.775194:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c73707a000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788197569.775199:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c708304a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c73707a9c0 00000020:00080000:2.0:1788197569.775459:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c708304b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c6010cb400 00000100:00100000:0.0:1788197569.775636:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776309888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788197569.775712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788197569.775809:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000001:00080000:2.0:1788197569.776116:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1788197569.776129:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c73707af00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788197569.776132:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c740fcf900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c73707a540 00000020:00080000:2.0:1788197569.776135:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c740fcf700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c708075000 00000004:00080000:2.0:1788197569.776175:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788197569.776332:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10561:x1875060755325056:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 64112us (64311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.776341:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 124 00000100:00100000:2.0:1788197569.776697:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776310016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788197569.777021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788197569.777263:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788197569.777286:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788197569.778771:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776309888 00000100:00100000:0.0:1788197569.778783:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776309888 00000100:00100000:0.0:1788197569.778853:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776310016 00000100:00100000:0.0:1788197569.778856:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776310016 00000100:00100000:0.0:1788197569.778879:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788197569.778887:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776309888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788197569.778914:0:8021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788197569.778943:0:8021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a95babf, atime: 0x6a95babf, ctime: 0x6a95babf, blocks: 0x1 00010000:00010000:0.0:1788197569.778951:0:8021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.778967:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1788197569.778972:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197569.778978:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.778993:0:8021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779002:0:8021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779009:0:8021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779042:0:8021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788197569.779523:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875060776309888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 635us (3810us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788197569.779531:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788197569.779549:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788197569.779555:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776310016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788197569.779567:0:8021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788197569.779580:0:8021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779595:0:8021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779603:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788197569.779606:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788197569.779610:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779640:0:8021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779655:0:8021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 11 pid: 6699 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.779669:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776310144:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197569.779746:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add180 going to sleep for 11 seconds 00010000:00010000:0.0:1788197569.779762:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197569.779768:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779775:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197569.779779:0:8526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779789:0:8526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779806:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779814:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c292403088f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.779850:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197569.779852:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197569.779854:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788197569.779881:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c736d24000/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788197569.779886:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776309888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788197569.780922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.781020:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755325184 00000100:00100000:2.0:1788197569.781027:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755325184 00000100:00100000:2.0:1788197569.781069:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1788197569.781077:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:2360:x1875060755325184:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788197569.783818:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776310272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788197569.783907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197569.783966:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788197569.783974:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788197569.784157:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776310144:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197569.784180:0:8021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.786213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.786248:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755325312 00000100:00100000:2.0:1788197569.786257:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755325312 00010000:00010000:2.0:1788197569.786292:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 13 pid: 6699 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.786333:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:2.0:1788197569.786345:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2360:x1875060755325312:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197569.786361:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197569.786367:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 13 pid: 6699 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.786382:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 13 pid: 6699 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.786405:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030651 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5857 expref: 13 pid: 6699 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.786421:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197569.786426:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197569.786432:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.786679:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.786722:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197569.786773:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:2360:x1875060755325312:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 430us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.786782:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00010000:00010000:3.0:1788197569.786921:0:8021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.786932:0:8021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.786942:0:8021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.786949:0:8021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.786964:0:8021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788197569.787628:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776310016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8070us (10604us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788197569.787637:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788197569.787656:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776310272 00000100:00100000:3.0:1788197569.787661:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776310272 00000100:00100000:3.0:1788197569.787706:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788197569.787714:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776310272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788197569.787819:0:8021:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788197569.787851:0:8021:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788197569 00002000:00010000:3.0:1788197569.787853:0:8021:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788197569.787855:0:8021:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788197569 -> 1788197569 00002000:00010000:3.0:1788197569.787858:0:8021:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788197569.789401:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1875060776310272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1681us (5487us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788197569.789412:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1788197569.789441:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197569.789449:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.789459:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197569.789464:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.789473:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.789491:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.789498:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f948dbb8/0x167e6c2924030896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.789516:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197569.789519:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197569.789520:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788197569.789556:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6066ddc00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788197569.789562:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776310272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788197569.789593:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c6066de680/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788197569.789598:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776310016:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788197569.831999:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1788197569.832016:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788197569.832025:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1788197569.832049:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788197569.832162:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755325184:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 51079us (51237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197569.832172:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1788197569.835928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197569.836009:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755325568 00000100:00100000:0.0:1788197569.836019:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755325568 00000100:00100000:0.0:1788197569.836076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:0.0:1788197569.836086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10561:x1875060755325568:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788197569.836136:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197569.836162:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c292403087a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ea expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.836182:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:0.0:1788197569.836186:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197569.836661:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.836678:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.836698:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788197569.837098:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a47b9e57 reply state 0000000098793923 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.837107:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788197569.837670:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:10561:x1875060755325568:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 1582us (1748us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788197569.837679:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 125 00000100:00100000:2.0:1788197569.842471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197569.842602:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755325696 00000100:00100000:3.0:1788197569.842612:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755325696 00000100:00100000:3.0:1788197569.842722:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:3.0:1788197569.842733:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755325696:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788197569.842956:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788197569.843080:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788197569 -> 1788197568 00002000:00010000:3.0:1788197569.843084:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788197567 00002000:00010000:3.0:1788197569.843086:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788197569 -> 1788197568 00002000:00010000:3.0:1788197569.843088:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788197569.843143:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755325696:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 412us (681us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788197569.843151:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00010000:00010000:0.0:1788197569.844735:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.844770:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.844778:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.844784:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197569.844788:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.844795:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.844812:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:0.0:1788197569.844815:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197569.844820:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.845224:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403089d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.845416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197569.845510:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755325952 00000100:00100000:3.0:1788197569.845524:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755325952 00000100:00100000:3.0:1788197569.845573:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:3.0:1788197569.845584:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:10561:x1875060755325952:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788197569.845651:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.845666:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.845674:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.845720:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.845747:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 15 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197569.845761:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776310400:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197569.845876:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788197569.849515:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776310400:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197569.849544:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.851884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197569.854764:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755326080 00000100:00100000:3.0:1788197569.854780:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755326080 00010000:00010000:2.0:1788197569.856493:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 16 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.856550:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:2.0:1788197569.856562:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:2360:x1875060755326080:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197569.856579:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197569.856587:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 16 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.856601:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 16 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.856628:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c292403085e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58dc expref: 16 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.856671:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:2.0:1788197569.856676:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.856686:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.856706:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.857184:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197569.857324:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:2360:x1875060755326080:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 762us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.857334:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00010000:00010000:3.0:1788197569.858793:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.858807:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.859382:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.859391:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.859398:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.859404:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197569.859423:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.859431:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.859446:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:0.0:1788197569.859449:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788197569.859454:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.859460:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c29240308a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.859644:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10561:x1875060755325952:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 14057us (14227us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788197569.859654:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 126 00000100:00100000:2.0:1788197569.864282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197569.864382:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755326208 00000100:00100000:0.0:1788197569.864391:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755326208 00000100:00100000:0.0:1788197569.864494:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:0.0:1788197569.864504:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755326208:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788197569.864546:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.864567:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.864578:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788197569.864583:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788197569.864602:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.864635:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.864650:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 7 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.864664:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875060776310528:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197569.864753:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add480 going to sleep for 11 seconds 00000100:00100000:2.0:1788197569.870628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197569.871332:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755326336 00000100:00100000:1.0:1788197569.871342:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755326336 00010000:00010000:1.0:1788197569.871381:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 8 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197569.871424:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:1.0:1788197569.871433:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755326336:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197569.871446:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197569.871467:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 8 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.871492:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 8 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.871519:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197569.871524:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197569.871529:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.871538:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.871557:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197569.871599:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755326336:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 167us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197569.871606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00010000:00010000:0.0:1788197569.879192:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c2924030888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58f8 expref: 7 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.879225:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875060776310528:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197569.879253:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879567:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879578:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879629:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879637:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879646:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879653:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197569.879658:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879667:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879699:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.879708:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ec5195/0x167e6c29240308ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197569.879819:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755326208:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 15314us (15543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197569.879867:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:2.0:1788197569.884353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197569.884701:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755326592 00000100:00100000:1.0:1788197569.884712:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755326592 00000100:00100000:1.0:1788197569.884769:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 127 00000100:00100000:1.0:1788197569.884794:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10561:x1875060755326592:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788197569.884885:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.884900:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.884910:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.885085:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.885096:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.885103:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.885135:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.885148:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 15 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197569.885160:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776310656:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197569.886049:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c72727ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197569.889655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.890111:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755326720 00000100:00100000:2.0:1788197569.890122:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755326720 00010000:00010000:2.0:1788197569.890168:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 16 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.890284:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1788197569.890296:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+16:2359:x1875060755326720:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197569.890310:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197569.890318:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 16 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.890352:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 16 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.890373:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:2.0:1788197569.890378:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.890386:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.890392:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.890399:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403086c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58e3 expref: 16 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.890408:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197569.890414:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776310656:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197569.890434:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.890442:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.890448:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.890580:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:2359:x1875060755326720:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 285us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.890588:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000001:00080000:1.0:1788197569.891145:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788197569.891315:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788197569.891363:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788197569.891449:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776310784:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788197569.891533:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197569.891565:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70ad42000 going to sleep for 11 seconds 00000100:00100000:2.0:1788197569.892084:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776310784 00000100:00100000:2.0:1788197569.892091:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776310784 00000100:00100000:2.0:1788197569.892141:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788197569.892150:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1875060776310784:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788197569.892244:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1875060776310784:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.892252:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788197569.892410:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788197569.892416:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1788197569.892440:0:5841:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93c6066de680 x1875060776310016/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788197585 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197569.892453:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776310784:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788197569.892956:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788197569.893021:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776310912:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788197569.893060:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197569.893078:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7060eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197569.893228:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776310912 00000100:00100000:2.0:1788197569.893234:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776310912 00000100:00100000:2.0:1788197569.893263:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788197569.893271:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5841:x1875060776310912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788197569.893456:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5841:x1875060776310912:12345-0@lo:1000:mdt00_000.0 Request processed in 184us (394us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788197569.893463:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788197569.893937:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1875060776310912:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788197569.893970:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.893979:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.893986:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.893993:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abee00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197569.893998:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894006:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894020:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c719ede300) 00010000:00010000:1.0:1788197569.894023:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197569.894027:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894033:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894063:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894070:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894075:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894089:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197569.894093:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894099:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894107:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197569.894109:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197569.894116:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894126:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894135:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.894164:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197569.894175:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737007480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776311040:192.168.206.40@tcp:105: 00000100:00100000:1.0:1788197569.895226:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c72727ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197569.900027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197569.900128:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737007480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776311040:192.168.206.40@tcp:105: 00010000:00010000:1.0:1788197569.900156:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900193:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240307fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900234:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900248:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900258:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900268:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900274:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900281:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900286:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abee00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197569.900291:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900298:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900313:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197569.900316:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197569.900319:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900332:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240308c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900342:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900348:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900354:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900359:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197569.900362:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900367:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900375:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197569.900377:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788197569.900379:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.900384:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197569.900596:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:10561:x1875060755326592:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 15813us (16252us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788197569.900605:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 127 00000020:00080000:1.0:1788197569.900616:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788197569.900676:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197569.900681:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788197569.901158:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755326848 00000100:00100000:2.0:1788197569.901166:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755326848 00000100:00100000:2.0:1788197569.901213:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:2.0:1788197569.901223:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:10560:x1875060755326848:12345-192.168.206.40@tcp:49:lfs.0 00000100:00100000:2.0:1788197569.901326:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:10560:x1875060755326848:12345-192.168.206.40@tcp:49:lfs.0 Request processed in 104us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197569.901333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00000040:00080000:3.0:1788197569.901489:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788197569.901499:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788197569.904341:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197569.904363:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197569.904428:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197569.904922:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776311168 00000100:00100000:0.0:1788197569.904930:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776311168 00000100:00100000:0.0:1788197569.904979:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788197569.904988:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776311168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197569.905020:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197569.905077:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776311168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197569.905099:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788197569.905348:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776311168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197569.916448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197569.916497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.916584:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755327104 00000100:00100000:2.0:1788197569.916595:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755327104 00000100:00100000:2.0:1788197569.916651:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:2.0:1788197569.916664:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7048c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:10561:x1875060755327104:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788197569.916759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755327360 00000100:00100000:3.0:1788197569.916763:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755327360 00000100:00100000:3.0:1788197569.916806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 128 00000100:00100000:3.0:1788197569.916814:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:10560:x1875060755327360:12345-192.168.206.40@tcp:58:lfs.0 00000040:00080000:3.0:1788197569.917163:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788197569.917241:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10560:x1875060755327360:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 427us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197569.917249:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 128 00000004:00080000:2.0:1788197569.917357:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788197569.917460:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788197569.917501:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.917515:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.917526:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.917533:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.917549:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.917555:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.917579:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788197569.917626:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7048c2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10561:x1875060755327104:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 965us (1189us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788197569.917634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000020:00080000:2.0:1788197569.917638:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788197569.917860:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197569.917866:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.917873:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197569.917877:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.917885:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.917896:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93c7028a4800) 00010000:00010000:3.0:1788197569.917899:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788197569.917904:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.917910:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240308c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197569.917926:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197569.917928:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197569.917930:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197569.990869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.991104:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755327488 00000100:00100000:2.0:1788197569.991115:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755327488 00000100:00100000:2.0:1788197569.991162:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 129 00000100:00100000:2.0:1788197569.991173:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:10563:x1875060755327488:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197569.991196:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197569.991288:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c29240308ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d58ff expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991351:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991364:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991375:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991388:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991406:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991413:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991639:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991651:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991659:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991700:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197569.991714:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 21 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197569.991728:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74111b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776311296:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197569.992162:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197569.995410:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74111b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776311296:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197569.995439:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197569.995620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197569.995731:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755327744 00000100:00100000:2.0:1788197569.995752:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755327744 00000100:00100000:2.0:1788197569.995806:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:2.0:1788197569.995816:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:5598:x1875060755327744:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788197569.996082:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:5598:x1875060755327744:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 265us (461us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788197569.996089:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:0.0:1788197569.999052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197569.999145:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755327872 00000100:00100000:1.0:1788197569.999154:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755327872 00010000:00010000:1.0:1788197569.999194:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 23 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197569.999338:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:1.0:1788197569.999349:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:2359:x1875060755327872:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197569.999361:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197569.999367:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 23 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.999380:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 23 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.999401:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c29240307ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c0 expref: 23 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.999415:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197569.999419:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.999428:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.999435:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197569.999472:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197569.999535:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:2359:x1875060755327872:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 187us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197569.999543:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00010000:00010000:0.0:1788197569.999600:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999608:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197569.999654:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788197569.999659:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197569.999678:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999700:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999709:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999716:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999722:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999728:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197569.999732:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999746:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999756:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:0.0:1788197569.999759:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197569.999763:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999768:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240308d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197569.999778:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000241:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000250:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000255:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197570.000258:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000264:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000274:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93c7028a4700) 00010000:00010000:0.0:1788197570.000276:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197570.000279:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000295:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c29240308dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000334:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c29240308ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ff expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000347:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ff expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197570.000354:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:0.0:1788197570.000357:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197570.000359:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155ca00, rc 0) 00000100:00100000:0.0:1788197570.000396:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10563:x1875060755327488:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 9225us (9572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197570.000403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 129 00010000:00010000:3.0:1788197570.161097:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197570.414679:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197570.414713:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776311424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197570.414777:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197570.414847:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776311424 00000100:00100000:0.0:1788197570.414856:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776311424 00000100:00100000:0.0:1788197570.414902:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788197570.414913:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875060776311424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197570.414934:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788197570.414992:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1875060776311424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197570.415061:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776311424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197570.424864:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000040:00080000:2.0:1788197570.911257:0:12125:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788197570.911266:0:12125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788197570.911318:0:12125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788197570.911324:0:12125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788197570.932022:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788197570.932032:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788197570.932089:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788197570.932097:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788197570.932210:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74111b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776311552:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788197570.932302:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788197570.938563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197570.938794:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755328000 00000100:00100000:3.0:1788197570.938804:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755328000 00000100:00100000:3.0:1788197570.938896:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:3.0:1788197570.938907:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:10574:x1875060755328000:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788197570.938945:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788197570.939073:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:10574:x1875060755328000:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 167us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197570.939083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 130 00000100:00100000:3.0:1788197570.939219:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74111b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776311552:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788197570.947786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197570.947841:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755328256 00000100:00100000:1.0:1788197570.947853:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755328256 00000100:00100000:1.0:1788197570.947912:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 131 00000100:00100000:1.0:1788197570.947921:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:10574:x1875060755328256:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197570.947943:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197570.947964:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c29240308ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5906 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.948084:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240308f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.948100:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240308f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.948116:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240308f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197570.948130:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788197570.951747:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c29240308ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5906 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.951773:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240308f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5906 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.951790:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197570.951793:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197570.951797:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfc00, rc 0) 00000100:00100000:1.0:1788197570.951886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10574:x1875060755328256:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 3964us (4110us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788197570.951895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 131 00000100:00100000:3.0:1788197570.959777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197570.959848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197570.959891:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755328640 00000100:00100000:3.0:1788197570.959900:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755328640 00000100:00100000:3.0:1788197570.959957:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:3.0:1788197570.959968:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:2360:x1875060755328640:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197570.959983:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197570.960006:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c29240308f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5906 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197570.960027:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:3.0:1788197570.960032:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197570.960076:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:2360:x1875060755328640:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 110us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197570.960084:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1788197570.960087:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755328512 00000100:00100000:1.0:1788197570.960092:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755328512 00000100:00100000:1.0:1788197570.960122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 132 00000100:00100000:1.0:1788197570.960129:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:10574:x1875060755328512:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788197570.960193:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960207:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960216:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960406:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960414:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960420:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960444:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197570.960449:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960456:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960466:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:1.0:1788197570.960468:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788197570.960472:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197570.960478:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c29240308ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197570.960593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10574:x1875060755328512:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 463us (825us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788197570.960601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 132 00000040:00080000:3.0:1788197570.961016:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197570.961021:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197570.961543:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788197570.961553:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788197570.967589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197570.968626:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755328896 00000100:00100000:2.0:1788197570.968638:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755328896 00000100:00100000:2.0:1788197570.969067:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:2.0:1788197570.969080:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:10574:x1875060755328896:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788197570.969334:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:10574:x1875060755328896:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 257us (1752us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788197570.969354:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00010000:00010000:3.0:1788197571.182289:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197572.206094:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788197572.491559:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788197572.491579:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:3.0:1788197572.691372:0:12177:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197572.691380:0:12177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197572.691431:0:12177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788197572.691438:0:12177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788197572.726031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197572.726073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197572.726103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197572.726127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197572.726153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197572.726179:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755329280 00000100:00100000:1.0:1788197572.726188:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755329280 00000100:00100000:1.0:1788197572.726236:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755329408 00000100:00100000:1.0:1788197572.726239:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755329408 00000100:00100000:1.0:1788197572.726259:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:1.0:1788197572.726268:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755329280:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197572.726349:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755329280:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197572.726358:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:1.0:1788197572.726374:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:1.0:1788197572.726381:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755329408:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197572.726406:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2358:x1875060755329408:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 25us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197572.726413:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:1.0:1788197572.726431:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755329536 00000100:00100000:1.0:1788197572.726434:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755329536 00000100:00100000:1.0:1788197572.726475:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755329152 00000100:00100000:1.0:1788197572.726478:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755329152 00000100:00100000:1.0:1788197572.726500:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 143 00000100:00100000:1.0:1788197572.726506:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2358:x1875060755329536:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197572.726536:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2358:x1875060755329536:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197572.726542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 143 00000100:00100000:1.0:1788197572.726554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 144 00000100:00100000:1.0:1788197572.726560:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:2358:x1875060755329152:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197572.726590:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:2358:x1875060755329152:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197572.726596:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 144 00000100:00100000:3.0:1788197572.726760:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755329024 00000100:00100000:3.0:1788197572.726765:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755329024 00000100:00100000:3.0:1788197572.726809:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 290 00000100:00100000:3.0:1788197572.726816:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755329024:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197572.726873:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2358:x1875060755329024:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 57us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197572.726880:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 290 00000100:00080000:0.0:1788197572.728784:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788197572.728794:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197572.728796:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197572.872143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197572.872185:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755329792 00000100:00100000:3.0:1788197572.872196:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755329792 00000100:00100000:3.0:1788197572.872253:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 133 00000100:00100000:3.0:1788197572.872263:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:10595:x1875060755329792:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197572.872282:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197572.872302:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030906 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d590d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.872412:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c292403090d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.872449:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c292403090d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.873572:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c292403090d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197572.873592:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788197572.873749:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d590d expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.873768:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c292403090d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d590d expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.873777:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:3.0:1788197572.873779:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788197572.873782:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7000, rc 0) 00000100:00100000:3.0:1788197572.873871:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10595:x1875060755329792:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1608us (1738us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788197572.874254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 133 00000100:00100000:3.0:1788197572.889361:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197572.889405:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755329920 00000100:00100000:3.0:1788197572.889416:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755329920 00000100:00100000:3.0:1788197572.890682:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00100000:3.0:1788197572.890698:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10595:x1875060755329920:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1788197572.890767:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890783:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890805:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890848:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890855:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890862:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890868:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197572.890872:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890952:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890966:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:3.0:1788197572.890969:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788197572.890974:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197572.890980:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c292403091b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197572.891057:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:10595:x1875060755329920:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 362us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197572.891066:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 134 00000100:00100000:3.0:1788197572.994113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197572.994252:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330048 00000100:00100000:1.0:1788197572.994264:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330048 00000100:00100000:1.0:1788197572.994425:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:1.0:1788197572.994447:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755330048:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:1.0:1788197572.994469:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197572.994492:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000195995b/0x167e6c2924030922 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5914 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788197572.994519:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a95bac0, atime: 0x6a95babf, ctime: 0x6a95bac0, blocks: 0xb 00010000:00010000:1.0:1788197572.994540:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1788197572.994545:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197572.994554:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000195995b/0x167e6c2924030922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5914 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197572.994574:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000195995b/0x167e6c2924030922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5914 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197572.994598:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe400, rc 0) 00000100:00100000:1.0:1788197572.994667:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2357:x1875060755330048:12345-192.168.206.40@tcp:101:cat.0 Request processed in 224us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197572.995483:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:3.0:1788197572.999751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197573.000261:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330176 00000100:00100000:2.0:1788197573.000286:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330176 00002000:00100000:2.0:1788197573.000343:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff93c736ac9180 x1875060755330176/t0(0) o3->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:468/0 lens 488/0 e 0 to 0 dl 1788197583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788197573.000354:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736ac9180 with x1875060755330176 ext(0->4095) 00002000:00010000:2.0:1788197573.000361:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c736ac9180 00000100:00100000:2.0:1788197573.000396:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:2.0:1788197573.000407:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2358:x1875060755330176:12345-192.168.206.40@tcp:3:cat.0 00000100:00100000:2.0:1788197573.000656:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2358:x1875060755330176:12345-192.168.206.40@tcp:3:cat.0 Request processed in 250us (918us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788197573.000664:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00002000:00100000:2.0:1788197573.000803:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff93c736ac9180 x1875060755330176/t0(0) o3->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:468/0 lens 488/4536 e 0 to 0 dl 1788197583 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788197573.000812:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736ac9180 with x1875060755330176 ext(0->4095) 00002000:00010000:2.0:1788197573.000816:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c736ac9180 00010000:00010000:3.0:1788197573.242537:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197574.255131:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197574.510096:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776311808:0@lo:400:kworker.0 00000100:00100000:3.0:1788197574.510162:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197574.510271:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197574.510284:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74111b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776311680:0@lo:400:kworker.0 00000100:00100000:0.0:1788197574.510316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197574.510350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776311680 00000100:00100000:0.0:1788197574.510357:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776311680 00000100:00100000:0.0:1788197574.510404:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788197574.510421:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776311680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197574.510473:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3311:x1875060776311680:12345-0@lo:400:kworker.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197574.510480:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788197574.510523:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74111b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776311680:0@lo:400:kworker.0 00000100:00100000:0.0:1788197574.510569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776311808 00000100:00100000:0.0:1788197574.510585:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776311808 00000100:00100000:0.0:1788197574.510616:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788197574.510623:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776311808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197574.517058:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776311808:12345-0@lo:400:kworker.0 Request processed in 6423us (6884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197574.517076:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788197574.517549:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776311936:0@lo:400:kworker.0 00000100:00100000:2.0:1788197574.517608:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197574.517760:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776311936 00000100:00100000:1.0:1788197574.517768:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776311936 00000100:00100000:1.0:1788197574.517842:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788197574.517852:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776311936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197574.517910:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776311936:12345-0@lo:400:kworker.0 Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197574.517916:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788197574.518008:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776311936:0@lo:400:kworker.0 00000100:00100000:2.0:1788197574.518069:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788197574.518076:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776312320:0@lo:400:kworker.0 00000100:00100000:2.0:1788197574.518119:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197574.518146:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312320 00000100:00100000:2.0:1788197574.518151:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312320 00000100:00100000:2.0:1788197574.518183:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788197574.518189:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776312320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197574.518226:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776312320:12345-0@lo:400:kworker.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197574.518253:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788197574.518281:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788197574.518286:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788197574.518300:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c736d24000, transno 4294967304 00000100:00100000:2.0:1788197574.518310:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776312320:0@lo:400:kworker.0 00000100:00100000:1.0:1788197574.519071:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776312192:0@lo:400:kworker.0 00000100:00100000:1.0:1788197574.519123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197574.519151:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788197574.519158:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776312064:0@lo:400:kworker.0 00000100:00100000:1.0:1788197574.519180:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197574.519223:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312192 00000100:00100000:1.0:1788197574.519227:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312192 00000100:00100000:1.0:1788197574.519266:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788197574.519273:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776312192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197574.519314:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776312192:12345-0@lo:400:kworker.0 Request processed in 42us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197574.519321:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788197574.519353:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776312192:0@lo:400:kworker.0 00000100:00080000:0.0:1788197574.520000:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197574.520006:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197574.520447:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776311808:0@lo:400:kworker.0 00000100:00100000:3.0:1788197574.520479:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312064 00000100:00100000:3.0:1788197574.520484:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312064 00000100:00100000:3.0:1788197574.520571:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788197574.520587:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3312:x1875060776312064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197574.520644:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3312:x1875060776312064:12345-0@lo:400:kworker.0 Request processed in 57us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197574.520650:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788197574.520700:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776312064:0@lo:400:kworker.0 00000100:00080000:0.0:1788197574.528481:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197575.041752:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776312448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197575.041819:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197575.042037:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312448 00000100:00100000:3.0:1788197575.042044:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312448 00000100:00100000:3.0:1788197575.042097:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788197575.042106:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776312448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197575.042143:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197575.042194:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776312448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197575.042201:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788197575.042241:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776312448:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788197575.090529:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197575.090539:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197575.090573:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788197575.090580:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788197575.192409:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788197575.192441:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788197575.226139:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000001:00080000:0.0:1788197575.226351:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1788197575.226366:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c70ad42d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788197575.226371:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c740fcf000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c70ad42000 00000020:00080000:0.0:1788197575.226374:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c740fcfc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c7417d5400 00000020:00080000:0.0:1788197575.226418:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788197575.226423:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000001:00080000:0.0:1788197575.226433:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:0.0:1788197575.226458:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788197575.226562:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788197575.226772:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788197575.279856:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197575.534096:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197575.534193:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776312576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197575.534267:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197575.534478:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312576 00000100:00100000:1.0:1788197575.534486:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312576 00000100:00100000:1.0:1788197575.534957:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788197575.534970:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776312576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788197575.535009:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197575.535076:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776312576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197575.535084:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788197575.535285:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788197575.535291:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6066de680, transno 4294967309 00000004:00080000:3.0:1788197575.535308:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c6066ddc00, transno 4294967310 00000004:00080000:3.0:1788197575.535313:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788197575.535343:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776312576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197576.302024:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197577.326974:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197577.841638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197577.841727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197577.841763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197577.841788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197577.842242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197577.842338:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330560 00000100:00100000:2.0:1788197577.842348:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330560 00000100:00100000:2.0:1788197577.842414:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330688 00000100:00100000:2.0:1788197577.842417:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330688 00000100:00100000:2.0:1788197577.842454:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:2.0:1788197577.842464:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755330560:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197577.842535:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755330560:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 73us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197577.842543:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:2.0:1788197577.842561:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:2.0:1788197577.842568:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755330688:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197577.842594:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755330688:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197577.842601:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00080000:3.0:1788197577.842852:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788197577.842989:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197577.844514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330304 00000100:00100000:1.0:1788197577.844524:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330304 00000100:00100000:1.0:1788197577.844584:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 292 00000100:00100000:1.0:1788197577.844593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755330304:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197577.844667:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2359:x1875060755330304:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 74us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197577.844674:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 292 00000100:00100000:1.0:1788197577.844709:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330816 00000100:00100000:1.0:1788197577.844714:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330816 00000100:00100000:1.0:1788197577.844747:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330432 00000100:00100000:1.0:1788197577.844750:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330432 00000100:00100000:1.0:1788197577.844773:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 148 00000100:00100000:1.0:1788197577.844779:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755330816:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197577.844808:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755330816:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 29us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197577.844815:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 148 00000100:00100000:1.0:1788197577.844857:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 149 00000100:00100000:1.0:1788197577.844864:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2359:x1875060755330432:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197577.844900:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2359:x1875060755330432:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 37us (3112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197577.844907:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 149 00000100:00080000:0.0:1788197577.845103:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197578.285757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197578.286125:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755330944 00000100:00100000:1.0:1788197578.286135:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755330944 00000100:00100000:1.0:1788197578.286195:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00100000:1.0:1788197578.286205:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:10240:x1875060755330944:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788197578.286314:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:10240:x1875060755330944:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 Request processed in 110us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197578.286339:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 135 00000100:00100000:0.0:1788197578.293228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197578.294293:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755331200 00000100:00100000:2.0:1788197578.294303:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755331200 00000100:00100000:2.0:1788197578.294352:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:2.0:1788197578.294361:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:10240:x1875060755331200:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788197578.294669:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:10240:x1875060755331200:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 307us (1449us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788197578.294691:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00010000:00010000:3.0:1788197578.350155:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197578.679014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197578.679132:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755331328 00000100:00100000:1.0:1788197578.679142:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755331328 00000100:00100000:1.0:1788197578.679201:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 136 00000100:00100000:1.0:1788197578.679211:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:11049:x1875060755331328:12345-192.168.206.40@tcp:101:lsof.0 00010000:00010000:1.0:1788197578.679229:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197578.679247:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030929 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d591b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197578.679301:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197578.679313:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197578.679324:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197578.679355:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788197578.679359:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197578.679408:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197578.679431:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030929 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197578.679447:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197578.679471:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:1.0:1788197578.679474:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788197578.679477:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf000, rc 0) 00000100:00100000:1.0:1788197578.679529:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:11049:x1875060755331328:12345-192.168.206.40@tcp:101:lsof.0 Request processed in 319us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197578.679536:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 136 00010000:00010000:3.0:1788197579.374088:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197579.630448:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776312704:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.630521:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197579.630581:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776313216:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.630620:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197579.630662:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197579.630668:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776313088:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.630712:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197579.630745:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776312960:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.630786:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197579.630804:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788197579.630810:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776312832:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.630854:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197579.630871:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776313344:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.630893:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197579.630922:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313216 00000100:00100000:3.0:1788197579.630928:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313216 00000100:00100000:3.0:1788197579.630974:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312960 00000100:00100000:3.0:1788197579.630977:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312960 00000100:00100000:3.0:1788197579.630992:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312832 00000100:00100000:3.0:1788197579.630995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312832 00000100:00100000:3.0:1788197579.631009:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788197579.631017:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776313216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.631078:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776313216:12345-0@lo:400:kworker.0 Request processed in 62us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197579.631086:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788197579.631101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788197579.631107:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776312960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.631136:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776312960:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197579.631142:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788197579.631153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788197579.631159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776312832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.631200:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776312832:12345-0@lo:400:kworker.0 Request processed in 40us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197579.631206:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788197579.631238:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776312832:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.631247:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776312960:0@lo:400:kworker.0 00000100:00100000:3.0:1788197579.631271:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776313216:0@lo:400:kworker.0 00000100:00100000:1.0:1788197579.631904:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313088 00000100:00100000:1.0:1788197579.631910:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313088 00000100:00100000:1.0:1788197579.631954:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313344 00000100:00100000:1.0:1788197579.631957:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313344 00000100:00100000:1.0:1788197579.631979:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788197579.631987:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776313088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197579.632035:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776313088:12345-0@lo:400:kworker.0 Request processed in 48us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197579.632041:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788197579.632053:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788197579.632059:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776313344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197579.632092:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776313344:12345-0@lo:400:kworker.0 Request processed in 34us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197579.632098:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788197579.632125:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776313344:0@lo:400:kworker.0 00000100:00100000:1.0:1788197579.632154:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776313088:0@lo:400:kworker.0 00000100:00100000:0.0:1788197579.632281:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776312704 00000100:00100000:0.0:1788197579.632285:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776312704 00000100:00100000:0.0:1788197579.632319:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788197579.632326:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776312704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197579.632374:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776312704:12345-0@lo:400:kworker.0 Request processed in 48us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197579.632380:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:0.0:1788197579.632408:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197579.632412:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197579.632415:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197579.633558:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776312704:0@lo:400:kworker.0 00000100:00100000:1.0:1788197580.144563:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197580.144582:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776313472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197580.144678:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197580.144744:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313472 00000100:00100000:1.0:1788197580.144751:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313472 00000100:00100000:1.0:1788197580.144789:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788197580.144797:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776313472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788197580.144849:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197580.144889:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776313472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197580.144895:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788197580.144941:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7057a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776313472:0@lo:13:osp-pre-1-0.0 00000020:00080000:0.0:1788197580.228274:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788197580.228297:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788197580.228383:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788197580.228394:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788197580.399213:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197580.654729:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197580.654756:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776313600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197580.654839:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197580.655057:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313600 00000100:00100000:1.0:1788197580.655065:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313600 00000100:00100000:1.0:1788197580.655134:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788197580.655143:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776313600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788197580.655179:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197580.655216:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776313600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197580.655222:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788197580.655515:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776313600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197581.423721:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197582.446226:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788197582.520353:0:12378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:33:00 (1788197580) 00000100:00100000:3.0:1788197582.967552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197582.967593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197582.967638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197582.967664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197582.967716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197582.967743:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755331968 00000100:00100000:3.0:1788197582.967751:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755331968 00000100:00100000:3.0:1788197582.967801:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755331584 00000100:00100000:3.0:1788197582.967804:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755331584 00000100:00100000:3.0:1788197582.967869:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 153 00000100:00100000:3.0:1788197582.967880:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2360:x1875060755331968:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197582.967964:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2360:x1875060755331968:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 85us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197582.967972:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 153 00000100:00100000:3.0:1788197582.967994:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 154 00000100:00100000:3.0:1788197582.968001:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2360:x1875060755331584:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197582.968044:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2360:x1875060755331584:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 43us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197582.968050:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 154 00000100:00100000:3.0:1788197582.968192:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755331712 00000100:00100000:3.0:1788197582.968197:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755331712 00000100:00100000:3.0:1788197582.968223:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755331840 00000100:00100000:3.0:1788197582.968226:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755331840 00000100:00100000:3.0:1788197582.968243:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:3.0:1788197582.968249:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755331712:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197582.968275:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755331712:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197582.968281:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:3.0:1788197582.968290:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:3.0:1788197582.968295:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755331840:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197582.968314:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755331840:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 19us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197582.968319:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00080000:3.0:1788197582.968332:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788197582.968335:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788197582.968337:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197582.970868:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755331456 00000100:00100000:0.0:1788197582.970883:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755331456 00000100:00100000:0.0:1788197582.970956:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 294 00000100:00100000:0.0:1788197582.970967:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755331456:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197582.972139:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755331456:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 1167us (4590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197582.972167:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 294 00010000:00010000:0.0:1788197583.470505:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197584.054522:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197584.055121:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755332224 00000100:00100000:1.0:1788197584.055132:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755332224 00000100:00080000:3.0:1788197584.055194:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197584.055219:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 137 00000100:00100000:1.0:1788197584.055231:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:11314:x1875060755332224:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197584.055251:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197584.055271:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030937 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5922 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055355:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055368:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055379:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055392:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055399:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055405:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055649:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c292403094c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055659:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c292403094c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055667:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c292403094c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197584.055676:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788197584.055814:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.055865:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058329:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058338:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abee00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197584.058343:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058354:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058374:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c704a46400) 00010000:00010000:1.0:1788197584.058377:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197584.058382:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058388:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c292403093e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058410:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058417:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058423:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.058428:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abec00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197584.058431:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.059849:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.059873:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c704a46000) 00010000:00010000:1.0:1788197584.059889:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197584.059894:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.059901:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abec00/0x167e6c2924030945 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.060520:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924030937 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5922 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.060539:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c292403094c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5922 expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197584.060546:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:1.0:1788197584.060549:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197584.060552:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfc00, rc 0) 00000100:00100000:1.0:1788197584.060638:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:11314:x1875060755332224:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 5409us (6126us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788197584.060647:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 137 00000100:00100000:1.0:1788197584.070805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197584.070920:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755332352 00000100:00100000:2.0:1788197584.070930:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755332352 00000100:00100000:2.0:1788197584.070992:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1788197584.071002:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:2357:x1875060755332352:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197584.071018:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197584.071044:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfc00/0x167e6c292403094c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5922 expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197584.071062:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:2.0:1788197584.071067:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197584.071142:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2357:x1875060755332352:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 140us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197584.071149:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1788197584.071285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197584.071388:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755332480 00000100:00100000:2.0:1788197584.071393:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755332480 00000100:00100000:2.0:1788197584.071429:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 138 00000100:00100000:2.0:1788197584.071437:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:11314:x1875060755332480:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788197584.071508:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:11314:x1875060755332480:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 Request processed in 72us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197584.071515:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 138 00000040:00080000:3.0:1788197584.303998:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197584.304006:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197584.304487:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788197584.304498:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788197584.494595:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197584.752907:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776313984:0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.752971:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197584.753024:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788197584.753029:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776313856:0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.753048:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197584.753061:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776314368:0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.753080:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197584.753110:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313984 00000100:00100000:0.0:1788197584.753116:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313984 00000100:00100000:0.0:1788197584.753165:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313856 00000100:00100000:0.0:1788197584.753168:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313856 00000100:00100000:0.0:1788197584.753185:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788197584.753192:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776313984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.753234:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776313984:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197584.753241:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788197584.753258:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788197584.753264:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776313856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.753285:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776313856:12345-0@lo:400:kworker.0 Request processed in 21us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197584.753290:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788197584.753305:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776314368 00000100:00100000:0.0:1788197584.753307:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776314368 00000100:00100000:0.0:1788197584.753329:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788197584.753347:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776314368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.753371:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776314368:12345-0@lo:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197584.753376:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788197584.753389:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197584.753405:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197584.753437:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776313856:0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.753445:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776314368:0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.753452:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776313984:0@lo:400:kworker.0 00000100:00100000:3.0:1788197584.754274:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776313728:0@lo:400:kworker.0 00000100:00100000:3.0:1788197584.754325:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197584.754369:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776314240:0@lo:400:kworker.0 00000100:00100000:3.0:1788197584.754403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197584.754425:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197584.754432:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776314112:0@lo:400:kworker.0 00000100:00100000:3.0:1788197584.754468:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197584.754513:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776314112 00000100:00100000:3.0:1788197584.754519:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776314112 00000100:00100000:3.0:1788197584.754565:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788197584.754574:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776314112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197584.754626:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776314112:12345-0@lo:400:kworker.0 Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197584.754641:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788197584.754674:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776314112:0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.755498:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776313728 00000100:00100000:0.0:1788197584.755505:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776313728 00000100:00100000:0.0:1788197584.755542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788197584.755550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776313728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197584.755599:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776313728:12345-0@lo:400:kworker.0 Request processed in 49us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197584.755606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:2.0:1788197584.755634:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788197584.755647:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776314240 00000100:00100000:2.0:1788197584.755651:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776314240 00000100:00100000:2.0:1788197584.755689:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788197584.755696:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776314240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197584.755740:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776314240:12345-0@lo:400:kworker.0 Request processed in 44us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197584.755742:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776313728:0@lo:400:kworker.0 00000100:00100000:2.0:1788197584.755746:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788197584.755753:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776314240:0@lo:400:kworker.0 00000100:00080000:2.0:1788197584.755760:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197585.263529:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197585.264450:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776314496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197585.264621:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197585.264697:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776314496 00000100:00100000:1.0:1788197585.264707:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776314496 00000100:00100000:1.0:1788197585.264752:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788197585.264761:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776314496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788197585.264793:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197585.264974:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776314496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197585.264982:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788197585.265334:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776314496:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788197585.297256:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:3.0:1788197585.327132:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197585.327141:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197585.327634:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788197585.327643:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788197585.522730:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197585.775040:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197585.775085:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776314624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197585.775152:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197585.775218:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776314624 00000100:00100000:3.0:1788197585.775225:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776314624 00000100:00100000:3.0:1788197585.775266:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788197585.775274:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776314624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197585.775304:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197585.775342:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741051c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776314624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197585.775349:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788197585.775393:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776314624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197586.003022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.003116:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755332608 00000100:00100000:2.0:1788197586.003126:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755332608 00000100:00100000:2.0:1788197586.003196:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00100000:2.0:1788197586.003207:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:11357:x1875060755332608:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197586.003226:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197586.003245:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403095a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5929 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003309:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003324:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003337:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003353:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003361:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003369:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003641:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003650:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003656:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003661:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197586.003665:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003672:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003684:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:2.0:1788197586.003687:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.003692:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003697:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003709:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003714:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003719:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003729:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197586.003732:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003737:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003745:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c7028a4b00) 00010000:00010000:2.0:1788197586.003747:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.003749:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003755:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030968 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003787:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403095a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5929 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003797:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:2.0:1788197586.003800:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.003803:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c292403095a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5929 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.003812:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197586.003898:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:11357:x1875060755332608:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 692us (885us total) trans 0 rc 301/301 00000100:00100000:2.0:1788197586.003906:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 139 00000100:00080000:3.0:1788197586.004467:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197586.014974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.015019:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755332864 00000100:00100000:0.0:1788197586.015032:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755332864 00000100:00100000:0.0:1788197586.015098:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 140 00000100:00100000:0.0:1788197586.015110:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:11357:x1875060755332864:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:0.0:1788197586.015187:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197586.015216:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c29240302d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5762 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.015234:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:0.0:1788197586.015240:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197586.016799:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.016970:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.016981:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.017025:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.017042:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 5 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197586.017058:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776314752:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197586.017162:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197586.031209:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776314752:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197586.031243:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.035925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.035984:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755332992 00000100:00100000:2.0:1788197586.035994:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755332992 00010000:00010000:2.0:1788197586.036052:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 6 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.036086:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:2.0:1788197586.036095:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2359:x1875060755332992:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197586.036112:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197586.036119:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 6 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036132:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 6 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036153:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030930 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d591b expref: 6 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036169:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:2.0:1788197586.036175:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036184:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036192:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036220:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197586.036779:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755332992:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 681us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197586.036796:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00080000:2.0:1788197586.036854:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788197586.036885:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036893:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036915:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036925:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.036933:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197586.038523:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788197586.038539:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.038547:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.038553:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.038559:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197586.038563:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.038571:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.038592:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede700) 00010000:00010000:2.0:1788197586.038595:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.038609:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.038616:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403096f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197586.038633:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb93b719 reply state 000000005e1510b5 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.038642:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197586.038715:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:11357:x1875060755332864:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 23605us (23751us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788197586.038723:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 140 00010000:00010000:3.0:1788197586.041811:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.041861:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.041868:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.041874:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197586.041878:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.041884:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.041899:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c7028a4b00) 00010000:00010000:3.0:1788197586.041910:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197586.041915:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.041921:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030976 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.115816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.115937:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755333120 00000100:00100000:0.0:1788197586.115959:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755333120 00000100:00100000:0.0:1788197586.116024:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 141 00000100:00100000:0.0:1788197586.116036:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:11365:x1875060755333120:12345-192.168.206.40@tcp:101:lctl.0 00010000:00010000:0.0:1788197586.116060:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.116082:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c292403097d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5930 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.116144:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030984 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.116158:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.116169:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197586.116202:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788197586.116206:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197586.116224:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.116248:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c292403097d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5930 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.116353:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030984 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5930 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.116363:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:0.0:1788197586.116366:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197586.116370:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031200, rc 0) 00000100:00100000:0.0:1788197586.116495:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:11365:x1875060755333120:12345-192.168.206.40@tcp:101:lctl.0 Request processed in 461us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197586.116502:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 141 00000100:00100000:2.0:1788197586.167215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.167318:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755333248 00000100:00100000:0.0:1788197586.167326:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755333248 00000100:00100000:0.0:1788197586.167381:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 142 00000100:00100000:0.0:1788197586.167488:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:11371:x1875060755333248:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197586.167507:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.167528:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c292403098b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5937 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167589:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167612:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167623:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167636:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167643:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167649:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167783:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240309a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167805:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240309a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167812:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240309a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197586.167890:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788197586.167894:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197586.167912:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240309a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167924:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167930:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167936:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167942:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197586.167946:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167953:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167966:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:0.0:1788197586.167969:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197586.167974:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.167991:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168004:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168011:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168017:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168022:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197586.168025:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168031:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168039:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93c719ede800) 00010000:00010000:0.0:1788197586.168041:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197586.168044:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168049:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168082:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c292403098b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5937 expref: 16 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168094:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240309a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5937 expref: 15 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.168108:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197586.168111:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788197586.168114:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030800, rc 0) 00000100:00100000:0.0:1788197586.168231:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:11371:x1875060755333248:12345-192.168.206.40@tcp:101:bash.0 Request processed in 747us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197586.169662:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 142 00000100:00100000:0.0:1788197586.180743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.180852:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755333504 00000100:00100000:2.0:1788197586.180863:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755333504 00000100:00100000:2.0:1788197586.180930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 143 00000100:00100000:2.0:1788197586.180942:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+15:11371:x1875060755333504:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197586.180967:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197586.180988:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c29240309a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d593e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.181143:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.181159:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.181184:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.181244:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.181252:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.181259:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788197586.182588:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788197586.182799:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182813:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182848:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182884:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182892:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182899:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182905:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197586.182917:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182925:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182937:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197586.182940:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.182945:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.182952:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c29240309ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197586.182967:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020950e69 reply state 0000000037d0731a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.182976:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788197586.183008:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c29240309a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.183022:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.183030:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:2.0:1788197586.183032:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197586.183034:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d800, rc 0) 00000100:00100000:2.0:1788197586.183750:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:11371:x1875060755333504:12345-192.168.206.40@tcp:101:bash.0 Request processed in 2807us (3014us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788197586.183759:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 143 00010000:00010000:0.0:1788197586.190914:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.190934:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.190952:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.190958:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197586.190963:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.190971:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.190988:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4900) 00010000:00010000:0.0:1788197586.190991:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197586.190996:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.191002:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c29240309b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197586.192332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.192513:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755333632 00000100:00100000:2.0:1788197586.192523:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755333632 00000100:00100000:2.0:1788197586.192585:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:2.0:1788197586.192595:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2359:x1875060755333632:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197586.192622:0:12087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197586.192640:0:12087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5945 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197586.192667:0:12087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197586.192685:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1788197586.192689:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197586.192698:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 6 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.192714:0:12087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 6 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.192727:0:12087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c200, rc 0) 00000100:00100000:2.0:1788197586.192786:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755333632:12345-192.168.206.40@tcp:101:bash.0 Request processed in 192us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197586.192811:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00080000:3.0:1788197586.193253:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788197586.201369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.201657:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755333760 00000100:00100000:0.0:1788197586.201667:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755333760 00000100:00100000:0.0:1788197586.201767:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:0.0:1788197586.201778:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:11371:x1875060755333760:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197586.201796:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.202057:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d594c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.202097:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 7 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.202106:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197586.202111:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197586.202116:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.202151:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 7 pid: 12087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.202165:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 7 pid: 12087 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197586.202179:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1875060776314880:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197586.202286:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197586.206725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.207191:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755333888 00000100:00100000:2.0:1788197586.207201:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755333888 00010000:00010000:2.0:1788197586.207239:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 8 pid: 12087 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.207272:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:2.0:1788197586.207294:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755333888:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197586.207307:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197586.207328:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 8 pid: 12087 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.207342:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 8 pid: 12087 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.207367:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197586.207371:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197586.207378:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.207400:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.207436:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.207448:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605582a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875060776315008:192.168.206.40@tcp:105: 00000100:00100000:2.0:1788197586.207528:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a900 going to sleep for 11 seconds 00010000:00010000:0.0:1788197586.209269:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240309ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5945 expref: 8 pid: 12087 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197586.209289:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6699:1875060776314880:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197586.209315:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.209329:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030a00, rc 0) 00000100:00100000:0.0:1788197586.209377:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:11371:x1875060755333760:12345-192.168.206.40@tcp:101:bash.0 Request processed in 7600us (8019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197586.209395:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:2.0:1788197586.211655:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605582a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1875060776315008:192.168.206.40@tcp:105: 00010000:00010000:2.0:1788197586.211680:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197586.211730:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755333888:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 4437us (5015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197586.211766:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:1.0:1788197586.218521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.218806:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755334144 00000100:00100000:2.0:1788197586.218863:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755334144 00000100:00100000:2.0:1788197586.218915:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:2.0:1788197586.218924:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:11371:x1875060755334144:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:2.0:1788197586.219238:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:11371:x1875060755334144:12345-192.168.206.40@tcp:35:bash.0 Request processed in 313us (726us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788197586.219246:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:1.0:1788197586.311509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.311579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755334400 00000100:00100000:0.0:1788197586.311590:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755334400 00000100:00100000:0.0:1788197586.311748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 144 00000100:00100000:0.0:1788197586.311759:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:11381:x1875060755334400:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197586.312132:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.312154:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240309d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5953 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197586.312245:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788197586.312444:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240309d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5953 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.312459:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:0.0:1788197586.312463:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197586.312468:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240309d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5953 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.312501:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030e00, rc 0) 00000100:00100000:0.0:1788197586.312630:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11381:x1875060755334400:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 872us (1133us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788197586.312647:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 144 00000100:00100000:1.0:1788197586.318471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.318627:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755334656 00000100:00100000:2.0:1788197586.318637:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755334656 00000100:00100000:2.0:1788197586.318694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:2.0:1788197586.318704:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11381:x1875060755334656:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197586.318959:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11381:x1875060755334656:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 256us (497us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788197586.318966:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:1.0:1788197586.392336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.392450:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755334784 00000100:00100000:0.0:1788197586.392461:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755334784 00000100:00100000:0.0:1788197586.392527:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 145 00000100:00100000:0.0:1788197586.392537:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11387:x1875060755334784:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197586.392564:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.392584:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240309e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d595a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.392665:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240309ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.392679:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240309ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.392689:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240309ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197586.392721:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788197586.392725:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197586.392741:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240309ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.392768:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240309e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d595a expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.392809:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240309ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d595a expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.392885:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197586.392889:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197586.392892:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031e00, rc 0) 00000100:00100000:0.0:1788197586.392959:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:11387:x1875060755334784:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 423us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197586.392967:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 145 00000100:00100000:1.0:1788197586.401858:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.401996:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755335040 00000100:00100000:0.0:1788197586.402007:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755335040 00000100:00100000:0.0:1788197586.402071:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 146 00000100:00100000:0.0:1788197586.402083:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:11387:x1875060755335040:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197586.402106:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.402126:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240309f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5961 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.402234:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240309fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.402249:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240309fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.402260:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240309fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197586.402272:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788197586.402437:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c29240309f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5961 expref: 24 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.402459:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240309fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5961 expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.402468:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:0.0:1788197586.402471:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197586.402475:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:0.0:1788197586.402550:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:11387:x1875060755335040:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 468us (728us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788197586.402558:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 146 00000100:00100000:3.0:1788197586.406782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.407016:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755335296 00000100:00100000:0.0:1788197586.407027:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755335296 00000100:00100000:0.0:1788197586.407088:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 147 00000100:00100000:0.0:1788197586.407099:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:11387:x1875060755335296:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197586.407122:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.407141:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030a09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5968 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.407233:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.407245:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.407256:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197586.407286:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788197586.408478:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030a09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5968 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.408519:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5968 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.408530:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:0.0:1788197586.408533:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788197586.408536:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030c00, rc 0) 00000100:00100000:0.0:1788197586.408722:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:11387:x1875060755335296:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1624us (1948us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788197586.408731:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 147 00000100:00100000:2.0:1788197586.414804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197586.418591:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755335424 00000100:00100000:3.0:1788197586.418614:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755335424 00000100:00100000:3.0:1788197586.418689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1788197586.418698:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:2359:x1875060755335424:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197586.418712:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197586.418735:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240309fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5961 expref: 25 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.418753:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:3.0:1788197586.418757:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197586.418847:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:2359:x1875060755335424:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 124us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197586.418854:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:2.0:1788197586.421214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197586.421294:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755335552 00000100:00100000:3.0:1788197586.421305:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755335552 00000100:00100000:3.0:1788197586.421366:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1788197586.421378:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755335552:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:3.0:1788197586.421432:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.421469:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.421479:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197586.421484:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788197586.421488:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.421527:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.421542:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 6 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197586.421558:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741050e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776315136:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197586.421674:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197586.424885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.424972:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755335680 00000100:00100000:2.0:1788197586.424983:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755335680 00002000:00100000:2.0:1788197586.425031:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93c73bf5ed80 x1875060755335680/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:482/0 lens 504/0 e 0 to 0 dl 1788197597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788197586.425042:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c73bf5ed80 with x1875060755335680 ext(0->12) 00010000:00010000:2.0:1788197586.425050:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 7 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.425083:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 7 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197586.425090:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c73bf5ed80 00000100:00100000:2.0:1788197586.425125:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1788197586.425134:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755335680:12345-192.168.206.40@tcp:4:lfs.0 00000100:00100000:2.0:1788197586.425668:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755335680:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 533us (790us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788197586.425677:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00002000:00100000:2.0:1788197586.425684:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93c73bf5ed80 x1875060755335680/t4294967305(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:482/0 lens 504/448 e 0 to 0 dl 1788197597 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788197586.425693:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c73bf5ed80 with x1875060755335680 ext(0->12) 00010000:00010000:2.0:1788197586.425699:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 9 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.425710:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 9 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197586.425717:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c73bf5ed80 00000100:00100000:3.0:1788197586.426463:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741050e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776315136:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197586.426497:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197586.428752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197586.428935:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755335808 00000100:00100000:3.0:1788197586.428946:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755335808 00010000:00010000:3.0:1788197586.428990:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 9 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197586.429104:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:3.0:1788197586.429115:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2360:x1875060755335808:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197586.429130:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788197586.429152:0:8468:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788197586.429156:0:8468:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788197585 00002000:00010000:3.0:1788197586.429159:0:8468:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788197586 00002000:00010000:3.0:1788197586.429160:0:8468:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788197585 00010000:00010000:3.0:1788197586.429167:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 9 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.429182:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 9 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.429208:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c29240309d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d594c expref: 9 pid: 6699 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.429226:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788197586.429231:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788197586.429237:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.429247:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.429279:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197586.429345:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755335808:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 231us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197586.429354:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00010000:00010000:0.0:1788197586.429418:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429429:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429454:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429462:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429481:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429489:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197586.429494:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429502:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429515:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.429523:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bb227fa/0x167e6c2924030a1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197586.429580:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755335552:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 8204us (8377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197586.429587:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:0.0:1788197586.432640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197586.432721:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755336064 00000100:00100000:1.0:1788197586.432731:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755336064 00000100:00100000:1.0:1788197586.432791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:1.0:1788197586.432801:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7048c3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11387:x1875060755336064:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:1.0:1788197586.432917:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5968 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788197586.433169:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788197586.433238:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788197586.434165:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788197586.434231:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.434249:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.434258:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.434295:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.434311:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 28 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197586.434324:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776315264:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197586.434590:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c721e7b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788197586.437786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197586.437904:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755336192 00000100:00100000:3.0:1788197586.437913:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755336192 00010000:00010000:3.0:1788197586.437952:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 29 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197586.437994:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:3.0:1788197586.438003:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:2359:x1875060755336192:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197586.438017:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197586.438024:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 29 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.438037:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 29 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.438060:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:3.0:1788197586.438064:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.438072:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.438079:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.438095:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197586.438141:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:2359:x1875060755336192:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197586.438162:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00010000:00010000:2.0:1788197586.441538:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c29240309bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d593e expref: 28 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.441564:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776315264:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197586.441620:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.441632:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.441638:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197586.441764:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788197586.442332:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788197586.442549:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776315392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788197586.442626:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197586.442707:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197586.442756:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776315392 00000100:00100000:0.0:1788197586.442763:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776315392 00000100:00100000:0.0:1788197586.442974:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788197586.442984:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776315392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788197586.443074:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776315392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197586.443095:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788197586.443332:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776315392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788197586.443883:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788197586.443957:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776315520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788197586.444001:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788197586.444188:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197586.444482:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c72727ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197586.444518:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776315520 00000100:00100000:2.0:1788197586.444526:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776315520 00000100:00100000:2.0:1788197586.444565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788197586.444573:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875060776315520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788197586.444761:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875060776315520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 188us (758us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788197586.444769:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788197586.444869:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776315520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788197586.444916:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788197586.444953:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.444973:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.444982:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.444987:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197586.444992:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.445000:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.445016:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:1.0:1788197586.445019:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788197586.445023:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.445029:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788197586.445187:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788197586.445285:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788197586.445295:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382591471891ns, next at 383591470157ns, rc = 0 00000001:00080000:1.0:1788197586.445300:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788197586.445328:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:1.0:1788197586.445331:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788197586.445338:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5968 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197586.445463:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7048c3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:11387:x1875060755336064:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 12664us (12834us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788197586.445472:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000020:00080000:1.0:1788197586.445477:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788197586.448616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.448713:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755336320 00000100:00100000:2.0:1788197586.448726:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755336320 00000100:00100000:2.0:1788197586.448791:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 148 00000100:00100000:2.0:1788197586.448802:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:11387:x1875060755336320:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197586.448866:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197586.448891:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d596f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.448981:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d596f expref: 32 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.448997:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d596f expref: 32 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.449019:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197586.449022:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197586.449026:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d000, rc 0) 00000100:00100000:2.0:1788197586.449084:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11387:x1875060755336320:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 283us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197586.449090:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 148 00000100:00100000:3.0:1788197586.452061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.452157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755336576 00000100:00100000:2.0:1788197586.452167:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755336576 00000100:00100000:2.0:1788197586.452220:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:2.0:1788197586.452231:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11387:x1875060755336576:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197586.452477:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:11387:x1875060755336576:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 248us (431us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788197586.452484:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:3.0:1788197586.521136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.521451:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755336832 00000100:00100000:2.0:1788197586.521463:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755336832 00000100:00100000:2.0:1788197586.521579:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 149 00000100:00100000:2.0:1788197586.521589:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+33:11397:x1875060755336832:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197586.521625:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197586.521644:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5976 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197586.521756:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788197586.521934:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030a33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5976 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.521949:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:2.0:1788197586.521952:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197586.521958:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5976 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.521976:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d800, rc 0) 00000100:00100000:2.0:1788197586.522045:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11397:x1875060755336832:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 457us (924us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788197586.522053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 149 00000100:00100000:3.0:1788197586.524627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.524706:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755336960 00000100:00100000:2.0:1788197586.524715:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755336960 00000100:00100000:2.0:1788197586.524782:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 150 00000100:00100000:2.0:1788197586.524792:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11397:x1875060755336960:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:2.0:1788197586.524895:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.524911:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.524920:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.524935:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.524956:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.524962:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525053:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525061:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525068:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197586.525107:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525119:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525124:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525131:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525137:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197586.525141:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525147:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525166:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197586.525169:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.525173:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525178:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525193:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525198:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525204:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525210:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197586.525213:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525218:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525224:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4800) 00010000:00010000:2.0:1788197586.525226:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.525229:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525233:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525258:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525264:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525269:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525273:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197586.525276:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525282:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525289:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197586.525292:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197586.525294:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.525300:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.525373:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11397:x1875060755336960:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 581us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197586.525380:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 150 00000100:00100000:3.0:1788197586.527094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.527179:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755337216 00000100:00100000:2.0:1788197586.527188:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755337216 00000100:00100000:2.0:1788197586.527339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:2.0:1788197586.527363:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11397:x1875060755337216:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197586.527590:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:11397:x1875060755337216:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 229us (505us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788197586.527608:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00010000:00010000:0.0:1788197586.543500:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197586.561374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197586.561525:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755337472 00000100:00100000:0.0:1788197586.561534:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755337472 00000100:00100000:0.0:1788197586.561607:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 151 00000100:00100000:0.0:1788197586.561619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:11400:x1875060755337472:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197586.561645:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197586.561670:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c2924030a56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d597d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.561751:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.561767:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.561778:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.561793:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.561800:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.561807:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562162:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562190:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562198:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197586.562209:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788197586.562367:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562375:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562450:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562457:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742143a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197586.562461:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562469:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197586.562484:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197586.562488:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562494:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143a00/0x167e6c2924030a5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562508:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562520:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562526:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562531:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197586.562534:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562541:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562548:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c719ede800) 00010000:00010000:0.0:1788197586.562551:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197586.562553:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562559:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562611:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c742143400/0x167e6c2924030a56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562627:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.562634:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:0.0:1788197586.562637:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197586.562645:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030a00, rc 0) 00000100:00100000:0.0:1788197586.562714:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:11400:x1875060755337472:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1097us (1349us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788197586.562723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 151 00000100:00100000:3.0:1788197586.565280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197586.565482:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755337600 00000100:00100000:1.0:1788197586.565493:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755337600 00000100:00100000:1.0:1788197586.565554:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 152 00000100:00100000:1.0:1788197586.565565:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:11400:x1875060755337600:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:1.0:1788197586.565639:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565655:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565666:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565690:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565697:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565704:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565709:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197586.565714:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565734:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565747:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197586.565750:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197586.565755:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.565762:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197586.566051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:11400:x1875060755337600:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 486us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197586.566059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 152 00000100:00100000:3.0:1788197586.568288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197586.568447:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755337856 00000100:00100000:1.0:1788197586.568456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755337856 00000100:00100000:1.0:1788197586.568548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:1.0:1788197586.568559:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:11400:x1875060755337856:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197586.568812:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:11400:x1875060755337856:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 246us (523us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788197586.568839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:0.0:1788197586.829568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.829684:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755338112 00000100:00100000:2.0:1788197586.829694:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755338112 00000100:00100000:2.0:1788197586.829762:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 153 00000100:00100000:2.0:1788197586.829772:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:11431:x1875060755338112:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:2.0:1788197586.829796:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197586.829815:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5984 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.829955:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.829973:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.829985:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197586.829998:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788197586.830149:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030a80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5984 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.830171:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5984 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.830453:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197586.830456:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197586.830460:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c200, rc 0) 00000100:00100000:2.0:1788197586.830556:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:11431:x1875060755338112:12345-192.168.206.40@tcp:101:cat.0 Request processed in 784us (998us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788197586.830564:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 153 00000100:00100000:3.0:1788197586.837944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197586.837992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.838086:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755338368 00000100:00100000:2.0:1788197586.838096:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755338368 00000100:00100000:2.0:1788197586.838175:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1788197586.838197:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:11431:x1875060755338368:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:2.0:1788197586.838523:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+41:11431:x1875060755338368:12345-192.168.206.40@tcp:35:cat.0 Request processed in 327us (589us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788197586.838531:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:1.0:1788197586.838856:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755338496 00000100:00100000:1.0:1788197586.838862:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755338496 00000100:00100000:1.0:1788197586.838914:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1788197586.838923:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+41:2360:x1875060755338496:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197586.838936:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197586.838963:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030a87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5984 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.839001:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197586.839008:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197586.839032:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:2360:x1875060755338496:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 111us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197586.839039:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:0.0:1788197586.924585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197586.924691:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755338752 00000100:00100000:1.0:1788197586.924711:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755338752 00000100:00100000:1.0:1788197586.924777:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 154 00000100:00100000:1.0:1788197586.924788:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:11437:x1875060755338752:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:1.0:1788197586.924812:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197586.924815:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788197586.924867:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c29240309ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d595a expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.924896:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197586.924901:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197586.924913:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d598b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.925015:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.925029:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.925037:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.925088:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.925099:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 40 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197586.925113:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776315648:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197586.925252:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788197586.929915:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776315648:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197586.929952:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197586.934613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197586.934706:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755338880 00000100:00100000:3.0:1788197586.934715:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755338880 00010000:00010000:3.0:1788197586.934757:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 41 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197586.934801:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:3.0:1788197586.934848:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+41:2360:x1875060755338880:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197586.934864:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197586.934872:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 41 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.934899:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 41 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.934922:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d597d expref: 41 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.934960:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:3.0:1788197586.934966:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.934981:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.934989:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197586.935019:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197586.935082:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:2360:x1875060755338880:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 271us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197586.935090:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00010000:00010000:1.0:1788197586.935335:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.935344:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197586.935364:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788197586.935529:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030a95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.935544:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197586.935552:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197586.935555:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788197586.935564:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf400, rc 0) 00000100:00100000:1.0:1788197586.935615:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:11437:x1875060755338752:12345-192.168.206.40@tcp:101:dd.0 Request processed in 10828us (11040us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788197586.935623:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 154 00000100:00100000:0.0:1788197586.940949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197586.941037:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755339136 00000100:00100000:2.0:1788197586.941046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755339136 00000100:00100000:2.0:1788197586.941103:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 155 00000100:00100000:2.0:1788197586.941114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:11437:x1875060755339136:12345-192.168.206.40@tcp:36:dd.0 00010000:00010000:2.0:1788197586.941363:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.941380:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197586.941404:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197586.941487:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788197586.941513:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000573935a8 reply state 000000004b4c6fae transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197586.941524:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197586.941624:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+43:11437:x1875060755339136:12345-192.168.206.40@tcp:36:dd.0 Request processed in 510us (686us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788197586.941632:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 155 00000020:00080000:2.0:1788197586.941637:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788197586.944393:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.944410:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.944417:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.944422:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197586.944427:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.944435:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.944456:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:0.0:1788197586.944460:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197586.944465:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197586.944471:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030aaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197587.214761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197587.214872:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755339264 00000100:00100000:2.0:1788197587.214882:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755339264 00000100:00100000:2.0:1788197587.214943:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 156 00000100:00100000:2.0:1788197587.214952:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+42:11451:x1875060755339264:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:2.0:1788197587.214977:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197587.214996:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5992 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215054:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215065:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215076:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215088:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215123:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215131:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215230:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215242:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215250:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215283:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.215296:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 43 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197587.215308:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776315776:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197587.215603:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197587.229352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197587.229509:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776315776:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197587.229551:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197587.231739:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755339520 00000100:00100000:0.0:1788197587.231756:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755339520 00000100:00100000:0.0:1788197587.231860:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:0.0:1788197587.231874:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+44:5598:x1875060755339520:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788197587.232570:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+45:5598:x1875060755339520:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 696us (3225us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788197587.232580:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:3.0:1788197587.240738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.240865:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755339648 00000100:00100000:1.0:1788197587.240875:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755339648 00010000:00010000:1.0:1788197587.240921:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 45 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197587.240969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:1.0:1788197587.240982:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+45:2360:x1875060755339648:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197587.240998:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197587.241006:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 45 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.241019:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 45 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.241042:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030a9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d598b expref: 45 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.241057:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197587.241062:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.241070:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.241077:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.241128:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197587.241196:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+44:2360:x1875060755339648:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 216us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197587.241205:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00010000:00010000:0.0:1788197587.241410:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241420:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197587.241477:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788197587.241482:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197587.241522:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241537:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241547:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241555:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241562:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241575:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197587.241580:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241588:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241608:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197587.241611:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197587.241615:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241621:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241635:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241642:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241648:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241653:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197587.241656:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241662:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241682:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4800) 00010000:00010000:0.0:1788197587.241684:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197587.241687:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241694:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241732:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5992 expref: 44 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241745:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5992 expref: 43 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.241753:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:0.0:1788197587.241755:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197587.241757:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155da00, rc 0) 00000100:00100000:0.0:1788197587.241789:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+43:11451:x1875060755339264:12345-192.168.206.40@tcp:101:stat.0 Request processed in 26838us (27037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197587.241796:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 156 00000100:00100000:3.0:1788197587.323251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197587.323930:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755339904 00000100:00100000:2.0:1788197587.323958:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755339904 00000100:00100000:2.0:1788197587.324034:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 157 00000100:00100000:2.0:1788197587.324046:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+43:11457:x1875060755339904:12345-192.168.206.40@tcp:36:truncate.0 00010000:00010000:2.0:1788197587.324115:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197587.324147:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5992 expref: 43 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.324169:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197587.324175:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197587.325613:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.325630:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.325642:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197587.325694:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788197587.325716:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5e392bd reply state 0000000040045f55 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197587.325725:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197587.327343:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+45:11457:x1875060755339904:12345-192.168.206.40@tcp:36:truncate.0 Request processed in 3287us (4088us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788197587.327356:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 157 00000020:00080000:2.0:1788197587.327365:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788197587.335413:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.335432:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.335448:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.335473:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197587.335477:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.335485:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.335501:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:0.0:1788197587.335504:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197587.335508:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.335514:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030acd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197587.456962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.457062:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755340032 00000100:00100000:1.0:1788197587.457073:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755340032 00000100:00100000:1.0:1788197587.457131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 158 00000100:00100000:1.0:1788197587.457142:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+44:11471:x1875060755340032:12345-192.168.206.40@tcp:101:stat.0 00010000:00010000:1.0:1788197587.457167:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197587.457187:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5999 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457256:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457271:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457282:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457307:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457316:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457323:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457448:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457458:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457465:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197587.457508:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788197587.457512:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197587.457547:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457560:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457629:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457635:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457641:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457647:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197587.457651:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457660:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457680:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197587.457683:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197587.457688:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457694:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457709:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457715:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457721:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457726:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfe00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197587.457729:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457736:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457744:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c704a46c00) 00010000:00010000:1.0:1788197587.457747:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197587.457750:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457755:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457933:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457948:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.457955:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197587.457958:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197587.457960:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe800, rc 0) 00000100:00100000:1.0:1788197587.458014:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+45:11471:x1875060755340032:12345-192.168.206.40@tcp:101:stat.0 Request processed in 873us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197587.458022:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 158 00000100:00100000:3.0:1788197587.550355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197587.550724:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755340288 00000100:00100000:0.0:1788197587.550735:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755340288 00000100:00100000:0.0:1788197587.550809:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 159 00000100:00100000:0.0:1788197587.550861:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+45:11481:x1875060755340288:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197587.550884:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197587.550909:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59a0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197587.551004:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788197587.551139:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030af0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a0 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.551156:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:0.0:1788197587.551173:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197587.551181:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a0 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.551197:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030a00, rc 0) 00000100:00100000:0.0:1788197587.551281:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+46:11481:x1875060755340288:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 461us (944us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788197587.551289:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 159 00000100:00100000:3.0:1788197587.554312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.554430:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755340544 00000100:00100000:1.0:1788197587.554440:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755340544 00000100:00100000:1.0:1788197587.554502:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:1.0:1788197587.554512:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706341050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+46:11481:x1875060755340544:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197587.554747:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706341050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+47:11481:x1875060755340544:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 235us (444us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788197587.554755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00010000:00010000:3.0:1788197587.566364:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197587.627164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.627306:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755340800 00000100:00100000:1.0:1788197587.627317:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755340800 00000100:00100000:1.0:1788197587.627377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 160 00000100:00100000:1.0:1788197587.627501:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+47:11487:x1875060755340800:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1788197587.627528:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197587.627549:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030afe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59a7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.628119:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.628139:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.628148:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.628283:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.628299:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 48 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197587.628314:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776315904:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197587.629559:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433240 going to sleep for 11 seconds 00000100:00100000:3.0:1788197587.633694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197587.633811:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755340928 00000100:00100000:2.0:1788197587.633853:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755340928 00010000:00010000:2.0:1788197587.633898:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 49 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197587.633956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:2.0:1788197587.633968:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+49:2359:x1875060755340928:12345-192.168.206.40@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788197587.633977:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776315904:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197587.633986:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197587.633995:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 49 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.634004:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.634012:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 49 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.635510:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5999 expref: 49 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.635537:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197587.635542:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.635552:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.635560:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.635608:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197587.635676:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+48:2359:x1875060755340928:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1710us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197587.635685:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00010000:00010000:1.0:1788197587.636489:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.636511:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197587.636534:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788197587.636903:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030afe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.636927:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.636935:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197587.636939:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788197587.636943:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfe00, rc 0) 00000100:00100000:1.0:1788197587.636989:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+48:11487:x1875060755340800:12345-192.168.206.40@tcp:101:bash.0 Request processed in 9492us (9835us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788197587.636998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 160 00000100:00100000:3.0:1788197587.641084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197587.642478:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755341184 00000100:00100000:0.0:1788197587.642490:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755341184 00000100:00100000:0.0:1788197587.642553:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 161 00000100:00100000:0.0:1788197587.642563:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+48:11487:x1875060755341184:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:0.0:1788197587.643613:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.643636:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.643663:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788197587.643740:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788197587.643781:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061b38ac6 reply state 00000000d0e1f563 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197587.643790:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788197587.645371:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:11487:x1875060755341184:12345-192.168.206.40@tcp:36:bash.0 Request processed in 2797us (4284us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788197587.646977:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 161 00000020:00080000:0.0:1788197587.646989:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788197587.647653:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.647666:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.647673:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.647679:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197587.647684:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.647691:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.647708:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197587.647711:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197587.647715:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.647721:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197587.657026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197587.657692:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755341312 00000100:00100000:0.0:1788197587.657707:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755341312 00000100:00100000:0.0:1788197587.657772:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 162 00000100:00100000:0.0:1788197587.657785:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+50:11487:x1875060755341312:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197587.657855:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197587.657879:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030b1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59ae expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.657984:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.658005:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.658015:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.658072:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.658088:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 51 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197587.658104:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776316032:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197587.658195:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433240 going to sleep for 11 seconds 00000100:00100000:0.0:1788197587.663754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.664148:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755341440 00000100:00100000:1.0:1788197587.664159:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755341440 00010000:00010000:1.0:1788197587.664197:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 52 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197587.664239:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:1.0:1788197587.664249:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:2359:x1875060755341440:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197587.664279:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197587.664286:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 52 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.664299:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 52 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.664322:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197587.664327:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.664336:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.664343:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.664363:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197587.664432:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:2359:x1875060755341440:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 183us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197587.664439:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 67 00010000:00010000:2.0:1788197587.665089:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030b05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59a7 expref: 51 pid: 5842 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197587.665116:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776316032:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197587.665138:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.665147:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.665153:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197587.665204:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788197587.665208:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197587.665229:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.665261:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030b1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ae expref: 51 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.665277:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ae expref: 50 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.665285:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197587.665288:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197587.665291:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030e00, rc 0) 00000100:00100000:2.0:1788197587.665326:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+50:11487:x1875060755341312:12345-192.168.206.40@tcp:101:bash.0 Request processed in 7544us (8318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197587.665334:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 162 00000100:00100000:3.0:1788197587.669091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.669295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755341696 00000100:00100000:1.0:1788197587.669304:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755341696 00000100:00100000:1.0:1788197587.669487:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:1.0:1788197587.669499:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+50:11487:x1875060755341696:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:1.0:1788197587.669865:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:11487:x1875060755341696:12345-192.168.206.40@tcp:35:bash.0 Request processed in 368us (783us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788197587.669873:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:0.0:1788197587.774245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197587.774401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755341952 00000100:00100000:2.0:1788197587.774411:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755341952 00000100:00100000:2.0:1788197587.774470:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 163 00000100:00100000:2.0:1788197587.774481:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:11497:x1875060755341952:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197587.774507:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197587.774527:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59b5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197587.774630:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788197587.774759:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59b5 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.774776:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:2.0:1788197587.774779:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197587.774785:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59b5 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.774803:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155da00, rc 0) 00000100:00100000:2.0:1788197587.774935:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11497:x1875060755341952:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 456us (700us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788197587.774943:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 163 00000100:00100000:0.0:1788197587.790629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.790724:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755342080 00000100:00100000:1.0:1788197587.790734:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755342080 00000100:00100000:1.0:1788197587.790796:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 164 00000100:00100000:1.0:1788197587.790807:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11497:x1875060755342080:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:1.0:1788197587.790925:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.790940:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.790951:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.790964:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.790970:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.790976:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791049:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791057:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791064:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197587.791097:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791121:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791126:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791133:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791137:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197587.791142:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791149:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791160:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197587.791163:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197587.791166:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791172:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791183:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791188:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791193:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791204:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197587.791207:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791212:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791220:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c704a46c00) 00010000:00010000:1.0:1788197587.791222:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197587.791224:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791230:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791243:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791249:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791254:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791259:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfa00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197587.791262:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791267:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791284:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197587.791286:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197587.791290:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.791296:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197587.791370:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11497:x1875060755342080:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 565us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197587.791378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 164 00000100:00100000:3.0:1788197587.795104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197587.795501:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755342336 00000100:00100000:0.0:1788197587.795512:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755342336 00000100:00100000:0.0:1788197587.795573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:0.0:1788197587.795583:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11497:x1875060755342336:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:0.0:1788197587.795863:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+53:11497:x1875060755342336:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 280us (769us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788197587.795872:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:0.0:1788197587.860781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197587.860923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755342592 00000100:00100000:2.0:1788197587.860936:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755342592 00000100:00100000:2.0:1788197587.861005:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 165 00000100:00100000:2.0:1788197587.861019:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+53:11500:x1875060755342592:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197587.861050:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197587.861077:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861189:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861206:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861235:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861254:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861261:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861267:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861547:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861558:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861566:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197587.861578:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788197587.861716:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861724:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861738:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861745:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197587.861750:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861758:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861771:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197587.861775:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197587.861779:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.861786:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.862727:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.862739:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.862745:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.862750:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197587.862754:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.862773:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.862785:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4200) 00010000:00010000:2.0:1788197587.862788:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197587.862792:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.865027:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.865134:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59bc expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.865152:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59bc expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197587.865160:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197587.865163:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197587.865167:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155cc00, rc 0) 00000100:00100000:2.0:1788197587.865238:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:11500:x1875060755342592:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 4222us (4467us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788197587.865248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 165 00000001:00080000:2.0:1788197587.870791:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788197587.870812:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788197587.872209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197587.872265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197587.872307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755342720 00000100:00100000:1.0:1788197587.872319:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755342720 00000100:00100000:0.0:1788197587.872383:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755342848 00000100:00100000:0.0:1788197587.872388:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755342848 00000100:00100000:1.0:1788197587.872394:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00100000:1.0:1788197587.872407:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11500:x1875060755342720:12345-192.168.206.40@tcp:54:lfs.0 00000100:00100000:0.0:1788197587.872428:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:0.0:1788197587.872437:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:2358:x1875060755342848:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197587.872450:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197587.872475:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59bc expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.872479:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.872581:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.872601:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197587.880557:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:0.0:1788197587.880577:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197587.880690:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:2358:x1875060755342848:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 8247us (8418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197587.880703:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00010000:00010000:1.0:1788197587.883565:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.883602:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.883631:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.883636:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfa00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197587.883642:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.883650:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.883670:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:1.0:1788197587.883685:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197587.883689:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197587.883696:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197587.884208:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:11500:x1875060755342720:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 11394us (11598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197587.884233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 166 00000100:00100000:3.0:1788197587.886446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197587.886598:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755343104 00000100:00100000:0.0:1788197587.886609:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755343104 00000100:00100000:0.0:1788197587.886659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:0.0:1788197587.886669:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:11500:x1875060755343104:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197587.887770:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:11500:x1875060755343104:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 1096us (1438us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788197587.887781:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:3.0:1788197588.079809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.079904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.079941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.079969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.080003:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755343616 00000100:00100000:3.0:1788197588.080014:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755343616 00000100:00080000:3.0:1788197588.080039:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197588.080087:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 158 00000100:00100000:3.0:1788197588.080098:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755343616:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197588.080160:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2357:x1875060755343616:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.080168:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 158 00000100:00100000:2.0:1788197588.080634:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755343488 00000100:00100000:2.0:1788197588.080640:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755343488 00000100:00100000:2.0:1788197588.080680:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755343360 00000100:00100000:2.0:1788197588.080683:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755343360 00000100:00100000:2.0:1788197588.080715:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:2.0:1788197588.080722:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755343488:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197588.080752:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755343488:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 31us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.080759:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:2.0:1788197588.080771:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:2.0:1788197588.080776:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755343360:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197588.080793:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755343360:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 18us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.080798:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00080000:3.0:1788197588.081107:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788197588.081110:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788197588.082304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755343232 00000100:00100000:0.0:1788197588.082316:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755343232 00000100:00100000:0.0:1788197588.082384:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 296 00000100:00100000:0.0:1788197588.082394:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755343232:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197588.082467:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755343232:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 74us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197588.082474:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 296 00000100:00100000:3.0:1788197588.136737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.136853:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755343872 00000100:00100000:2.0:1788197588.136862:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755343872 00000100:00100000:2.0:1788197588.136984:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00100000:2.0:1788197588.136994:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:11518:x1875060755343872:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:2.0:1788197588.137014:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197588.137031:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59c3 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.137125:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.137139:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.137166:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197588.137178:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788197588.137303:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59c3 expref: 58 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.137323:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59c3 expref: 57 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.137332:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197588.137335:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788197588.137337:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c400, rc 0) 00000100:00100000:2.0:1788197588.137408:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11518:x1875060755343872:12345-192.168.206.40@tcp:101:cat.0 Request processed in 415us (680us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788197588.137415:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00080000:3.0:1788197588.137466:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197588.171100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197588.171182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755344000 00000100:00100000:0.0:1788197588.171192:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755344000 00000100:00100000:0.0:1788197588.171250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 168 00000100:00100000:0.0:1788197588.171260:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11519:x1875060755344000:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197588.171281:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197588.171297:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.171362:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.171388:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.171400:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197588.171432:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788197588.171436:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197588.171454:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.171483:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ca expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.171500:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ca expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.171508:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197588.171510:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197588.171513:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030a00, rc 0) 00000100:00100000:0.0:1788197588.171579:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11519:x1875060755344000:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 320us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197588.171586:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 168 00000100:00100000:0.0:1788197588.175971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197588.176051:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755344384 00000100:00100000:1.0:1788197588.176061:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755344384 00000100:00100000:1.0:1788197588.176115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1788197588.176125:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11519:x1875060755344384:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197588.176491:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11519:x1875060755344384:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 366us (529us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788197588.176499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1788197588.180984:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.181079:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755344512 00000100:00100000:2.0:1788197588.181087:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755344512 00000100:00100000:2.0:1788197588.181151:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1788197588.181160:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11519:x1875060755344512:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:2.0:1788197588.181172:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788197588.181194:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030b21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ae expref: 59 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.181214:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59c3 expref: 58 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.181247:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d596f expref: 57 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.181256:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4700) 00010000:00010000:2.0:1788197588.181266:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197588.181366:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11519:x1875060755344512:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 207us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.181384:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1788197588.184336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197588.184457:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755344640 00000100:00100000:1.0:1788197588.184467:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755344640 00000100:00100000:2.0:1788197588.184565:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 169 00000100:00100000:2.0:1788197588.184621:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11519:x1875060755344640:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:2.0:1788197588.184728:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.184749:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.184769:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197588.185123:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788197588.185689:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11519:x1875060755344640:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 1110us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.185698:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 169 00000100:00100000:0.0:1788197588.208795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.208991:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755344768 00000100:00100000:3.0:1788197588.209000:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755344768 00000100:00100000:3.0:1788197588.209057:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 170 00000100:00100000:3.0:1788197588.209066:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11521:x1875060755344768:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197588.209084:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197588.209102:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030b9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59d1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209174:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209198:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209208:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209221:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209227:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209232:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209311:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209319:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209325:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197588.209356:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788197588.209360:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197588.209387:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209400:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209418:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209425:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209431:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209437:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197588.209441:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209448:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209462:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197588.209465:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197588.209470:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209477:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030ba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209490:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209497:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209503:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209516:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197588.209520:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209526:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209534:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7065f6f00) 00010000:00010000:3.0:1788197588.209536:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197588.209539:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209544:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209573:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030b9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209596:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.209604:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:3.0:1788197588.209606:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197588.209608:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7c00, rc 0) 00000100:00100000:3.0:1788197588.209670:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11521:x1875060755344768:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 605us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.209679:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 170 00000040:00080000:3.0:1788197588.401279:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197588.401305:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197588.401363:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788197588.401370:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788197588.401505:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776316160:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788197588.401617:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736addb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197588.407490:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776316160:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788197588.410379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197588.410459:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755344896 00000100:00100000:0.0:1788197588.410470:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755344896 00000100:00100000:0.0:1788197588.410527:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 171 00000100:00100000:0.0:1788197588.410549:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11532:x1875060755344896:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788197588.410583:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788197588.410705:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11532:x1875060755344896:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197588.410713:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 171 00000100:00100000:0.0:1788197588.420074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197588.420164:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755345024 00000100:00100000:1.0:1788197588.420173:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755345024 00000100:00100000:1.0:1788197588.420226:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:1.0:1788197588.420235:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11532:x1875060755345024:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788197588.420299:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420315:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420327:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420384:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420393:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420400:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420427:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420435:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420453:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197588.420484:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788197588.420488:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197588.420499:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420509:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420515:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420522:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420527:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197588.420531:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420538:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420548:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:1.0:1788197588.420551:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197588.420555:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420561:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030bbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420582:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420597:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420604:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420608:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197588.420611:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420618:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420625:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93c704a46c00) 00010000:00010000:1.0:1788197588.420627:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197588.420630:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420635:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030bc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420648:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420654:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420660:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420670:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abee00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197588.420673:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420680:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420687:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:1.0:1788197588.420690:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197588.420693:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.420698:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197588.420768:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11532:x1875060755345024:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 533us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197588.420777:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:0.0:1788197588.427301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.427379:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755345280 00000100:00100000:2.0:1788197588.427388:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755345280 00000100:00100000:2.0:1788197588.427457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:2.0:1788197588.427467:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11532:x1875060755345280:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197588.427488:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197588.427509:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030bd0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427614:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427629:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427640:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197588.427650:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788197588.427740:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427748:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427755:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427761:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197588.427765:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427773:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427796:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:2.0:1788197588.427800:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788197588.427804:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427811:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427874:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030bd0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d8 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427885:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:2.0:1788197588.427887:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197588.427892:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030bd0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d8 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.427902:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d000, rc 0) 00000100:00100000:2.0:1788197588.427962:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11532:x1875060755345280:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 496us (671us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788197588.427970:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:1.0:1788197588.439450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.439513:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755345408 00000100:00100000:3.0:1788197588.439522:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755345408 00000100:00100000:3.0:1788197588.439579:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:3.0:1788197588.439601:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11532:x1875060755345408:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788197588.439635:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788197588.439732:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11532:x1875060755345408:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 143us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.439740:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 174 00000100:00100000:2.0:1788197588.445323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.445401:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755345664 00000100:00100000:3.0:1788197588.445411:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755345664 00000100:00100000:3.0:1788197588.445511:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:3.0:1788197588.445521:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11532:x1875060755345664:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788197588.445542:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197588.445545:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788197588.445569:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ca expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.445597:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197588.445601:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197588.445614:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030be5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59df expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788197588.446034:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788197588.446218:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.446231:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.446241:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.446287:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030be5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59df expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.446301:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59df expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.446308:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6f00) 00010000:00010000:3.0:1788197588.446310:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788197588.446313:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6e00, rc 0) 00000100:00100000:3.0:1788197588.446363:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11532:x1875060755345664:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 844us (1051us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788197588.446370:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 175 00000100:00100000:1.0:1788197588.451226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.451277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755345920 00000100:00100000:3.0:1788197588.451288:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755345920 00000100:00100000:3.0:1788197588.451348:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:3.0:1788197588.451358:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11532:x1875060755345920:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788197588.451419:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197588.451468:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030bec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59df expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451485:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6f00) 00010000:00010000:3.0:1788197588.451495:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197588.451514:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451525:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451534:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451546:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451560:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451631:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451637:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451642:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451648:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197588.451658:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451665:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451673:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197588.451676:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197588.451679:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451684:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924030bfa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451692:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451698:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451703:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451707:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197588.451709:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451714:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451720:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x43cca843 (ffff93c7065f6a00) 00010000:00010000:3.0:1788197588.451722:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197588.451729:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.451734:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x43cca843 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197588.451807:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11532:x1875060755345920:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 451us (589us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788197588.451815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 176 00000100:00100000:1.0:1788197588.460351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.460410:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755346048 00000100:00100000:3.0:1788197588.460419:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755346048 00000100:00100000:3.0:1788197588.460471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 177 00000100:00100000:3.0:1788197588.460481:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11532:x1875060755346048:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788197588.460500:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197588.460521:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030c08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.460554:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.460567:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.460578:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.460673:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030c08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.460780:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.460796:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:3.0:1788197588.460799:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788197588.460802:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7420c3e00, rc 0) 00000100:00100000:3.0:1788197588.461010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11532:x1875060755346048:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 529us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.461017:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 177 00000100:00100000:2.0:1788197588.477161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197588.477238:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755346304 00000100:00100000:0.0:1788197588.477249:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755346304 00000100:00100000:0.0:1788197588.477307:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 178 00000100:00100000:0.0:1788197588.477317:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11532:x1875060755346304:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788197588.477389:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.477404:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.477416:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788197588.477737:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788197588.477747:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384623924285ns, next at 385623921767ns, rc = 0 00000004:00010000:0.0:1788197588.477862:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021063b8d reply state 00000000ef998a26 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197588.477872:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788197588.478030:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11532:x1875060755346304:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 713us (878us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788197588.478053:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 178 00010000:00010000:0.0:1788197588.482917:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.482937:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.482946:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.482952:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197588.482958:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.482966:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.482983:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:0.0:1788197588.482987:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788197588.482991:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.482998:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030c16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197588.483300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197588.483365:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755346432 00000100:00100000:0.0:1788197588.483385:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755346432 00000100:00100000:0.0:1788197588.483437:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 179 00000100:00100000:0.0:1788197588.483447:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11532:x1875060755346432:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197588.483473:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197588.483506:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59ed expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.483572:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 61 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.483585:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 61 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.483615:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:0.0:1788197588.483618:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788197588.483621:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:0.0:1788197588.483689:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11532:x1875060755346432:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 242us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197588.483695:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 179 00000100:00100000:1.0:1788197588.490534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.490630:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755346560 00000100:00100000:3.0:1788197588.490641:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755346560 00000100:00100000:3.0:1788197588.490698:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:3.0:1788197588.490710:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2358:x1875060755346560:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788197588.491101:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2358:x1875060755346560:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 392us (575us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788197588.491110:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:1.0:1788197588.509289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.509354:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755346816 00000100:00100000:3.0:1788197588.509365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755346816 00000100:00100000:3.0:1788197588.509424:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1788197588.509434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11532:x1875060755346816:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788197588.517581:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11532:x1875060755346816:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 8134us (8286us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788197588.517608:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:1.0:1788197588.525786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.525874:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755347072 00000100:00100000:3.0:1788197588.525883:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755347072 00000100:00100000:3.0:1788197588.525929:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 180 00000100:00100000:3.0:1788197588.525939:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11532:x1875060755347072:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788197588.526094:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11532:x1875060755347072:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 156us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.526102:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 180 00000100:00100000:1.0:1788197588.532205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.532315:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755347200 00000100:00100000:2.0:1788197588.532325:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755347200 00000100:00100000:2.0:1788197588.532386:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 181 00000100:00100000:2.0:1788197588.532397:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11532:x1875060755347200:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197588.532420:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197588.532457:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59f4 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.532534:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.532547:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.532559:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197588.532604:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197588.532619:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.532643:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59f4 expref: 64 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.532658:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59f4 expref: 63 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.532666:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:2.0:1788197588.532669:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788197588.532673:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c400, rc 0) 00000100:00100000:2.0:1788197588.532725:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+63:11532:x1875060755347200:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 331us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.532732:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 181 00000100:00100000:1.0:1788197588.541317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.541385:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755347328 00000100:00100000:2.0:1788197588.541394:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755347328 00000100:00100000:2.0:1788197588.541467:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1788197588.541476:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755347328:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197588.541491:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197588.541512:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d59fb expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197588.541539:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95bad4, blocks: 0x1 00010000:00010000:2.0:1788197588.541556:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788197588.541561:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197588.541570:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.541600:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.541613:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197588.541669:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755347328:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 193us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.541675:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:1.0:1788197588.547126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.547363:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755347584 00000100:00100000:3.0:1788197588.547373:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755347584 00000100:00100000:3.0:1788197588.547433:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 182 00000100:00100000:3.0:1788197588.547444:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+63:11532:x1875060755347584:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788197588.547556:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+63:11532:x1875060755347584:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 114us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.547563:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 182 00000100:00100000:1.0:1788197588.561306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.561395:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755347712 00000100:00100000:3.0:1788197588.561404:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755347712 00000100:00100000:3.0:1788197588.561462:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:3.0:1788197588.561472:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:11532:x1875060755347712:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788197588.561489:0:8021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197588.561507:0:8021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a02 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.561538:0:8021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.561546:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197588.561551:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197588.561556:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 9 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.561619:0:8021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.561632:0:8021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 9 pid: 6699 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197588.561647:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776316288:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197588.561735:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add000 going to sleep for 11 seconds 00000100:00100000:3.0:1788197588.567171:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776316288:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197588.567206:0:8021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 9 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.567228:0:8021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6a00, rc 0) 00000100:00100000:3.0:1788197588.567289:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:11532:x1875060755347712:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 5818us (5990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.567299:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:1.0:1788197588.570714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.576629:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755347840 00000100:00100000:2.0:1788197588.576641:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755347840 00010000:00010000:2.0:1788197588.576684:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 9 pid: 6699 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197588.576716:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:2.0:1788197588.576726:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755347840:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197588.576749:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197588.576770:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 9 pid: 6699 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.576783:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 9 pid: 6699 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.576806:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086773a78/0x167e6c2924030c32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59fb expref: 9 pid: 6699 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.576845:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197588.576850:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197588.576859:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.576869:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.576905:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197588.576920:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875060776316416:192.168.206.40@tcp:105: 00000100:00100000:2.0:1788197588.577187:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788197588.589706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197588.589768:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755347968 00000100:00100000:0.0:1788197588.589776:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755347968 00002000:00100000:0.0:1788197588.589818:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93c741053480 x1875060755347968/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:484/0 lens 504/0 e 0 to 0 dl 1788197599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788197588.589853:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741053480 with x1875060755347968 ext(0->8) 00002000:00010000:0.0:1788197588.589858:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c741053480 00000100:00100000:0.0:1788197588.589888:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1788197588.589899:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755347968:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788197588.590334:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:2359:x1875060755347968:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 435us (634us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788197588.590342:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00002000:00100000:0.0:1788197588.590354:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93c741053480 x1875060755347968/t4294967314(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:484/0 lens 504/448 e 0 to 0 dl 1788197599 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788197588.590362:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741053480 with x1875060755347968 ext(0->8) 00002000:00010000:0.0:1788197588.590365:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c741053480 00000100:00100000:3.0:1788197588.590776:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875060776316416:192.168.206.40@tcp:105: 00010000:00010000:3.0:1788197588.590805:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197588.590873:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2359:x1875060755347840:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 14148us (20168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.590882:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00010000:00010000:3.0:1788197588.591793:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197588.592671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.592735:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755348096 00000100:00100000:2.0:1788197588.592744:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755348096 00000100:00100000:2.0:1788197588.592803:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 183 00000100:00100000:2.0:1788197588.593324:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+63:11532:x1875060755348096:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788197588.729665:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+63:11532:x1875060755348096:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 136831us (136990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.729679:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 183 00000001:00080000:2.0:1788197588.729717:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788197588.729724:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788197588.729765:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788197588.729779:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c721e7b540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788197588.729783:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c736ad9c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c721e7b300 00000020:00080000:2.0:1788197588.729787:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c736ad9300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c7373db400 00000001:00080000:2.0:1788197588.729863:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788197588.731259:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788197588.731425:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788197588.731444:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776316544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788197588.731504:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197588.731569:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776316672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788197588.731606:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197588.731643:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776316544 00000100:00100000:2.0:1788197588.731650:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776316544 00000100:00100000:2.0:1788197588.731695:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776316672 00000100:00100000:2.0:1788197588.731698:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776316672 00000100:00100000:2.0:1788197588.731719:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788197588.731727:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776316544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788197588.731879:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788197588.731882:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788197588 00002000:00010000:2.0:1788197588.731885:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788197588.731895:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788197588 -> 1788197588 00002000:00010000:2.0:1788197588.731897:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788197588.733485:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776316544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1748us (1971us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788197588.733499:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788197588.733528:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788197588.733539:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776316672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788197588.733561:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788197588.733600:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a95bad1, atime: 0x6a95bad2, ctime: 0x6a95bad1, blocks: 0xb 00010000:00010000:2.0:1788197588.733609:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.733623:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788197588.733627:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197588.733633:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.733647:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.733657:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.733665:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.733684:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788197588.735141:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776316672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1600us (3529us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788197588.735152:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788197588.735193:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197588.735198:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788197588.735239:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c605582680/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788197588.735244:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776316544:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788197588.735263:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197588.735269:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.735279:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197588.735283:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.735293:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.735310:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.735318:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099c9833b/0x167e6c2924030c40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.735337:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197588.735339:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197588.735340:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197588.738016:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788197588.738026:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788197588.740264:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93c605583480 x1875060776316672/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788197604 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788197588.740282:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c605583480/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788197588.740288:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776316672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788197588.745125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.745347:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755348224 00000100:00100000:3.0:1788197588.745381:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755348224 00000100:00100000:3.0:1788197588.745443:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:3.0:1788197588.745454:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2360:x1875060755348224:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788197588.792883:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2360:x1875060755348224:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 47420us (47760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.792895:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000001:00080000:3.0:1788197588.792931:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1788197588.792944:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788197588.803525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197588.805741:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755348480 00000100:00100000:1.0:1788197588.805755:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755348480 00000100:00100000:1.0:1788197588.806582:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 184 00000100:00100000:1.0:1788197588.806605:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:11532:x1875060755348480:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788197588.806657:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197588.806682:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59f4 expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.806699:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:1.0:1788197588.806704:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197588.806732:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.806745:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.806753:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197588.807010:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c2248ec reply state 0000000029269dc2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197588.807020:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788197588.807125:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11532:x1875060755348480:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 524us (3609us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788197588.807145:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 184 00010000:00010000:0.0:1788197588.812048:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.812071:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.812079:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.812085:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197588.812090:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.812097:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.812115:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:0.0:1788197588.812118:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197588.812123:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.812129:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030c47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197588.812236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.812339:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755348608 00000100:00100000:2.0:1788197588.812348:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755348608 00000100:00100000:2.0:1788197588.812401:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:2.0:1788197588.812412:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755348608:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788197588.812664:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788197588.812667:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788197588 -> 1788197587 00002000:00010000:2.0:1788197588.812670:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788197586 00002000:00010000:2.0:1788197588.812672:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788197588 -> 1788197587 00002000:00010000:2.0:1788197588.812674:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788197588.812730:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755348608:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 319us (499us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788197588.812737:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:1.0:1788197588.818733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.819031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755348864 00000100:00100000:3.0:1788197588.819041:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755348864 00000100:00100000:3.0:1788197588.819279:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 185 00000100:00100000:3.0:1788197588.819290:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:11532:x1875060755348864:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788197588.819361:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.819377:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.819387:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.819420:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.819435:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 18 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197588.819448:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776316800:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197588.819552:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add600 going to sleep for 11 seconds 00000100:00100000:3.0:1788197588.830181:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776316800:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197588.830210:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197588.830524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.830622:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755348992 00000100:00100000:2.0:1788197588.830630:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755348992 00010000:00010000:2.0:1788197588.830670:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 19 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197588.830791:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:2.0:1788197588.830803:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:2360:x1875060755348992:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197588.830924:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197588.830933:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 19 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.830946:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 19 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.830967:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c3e00/0x167e6c2924030c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59e6 expref: 19 pid: 5842 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.830983:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:2.0:1788197588.830987:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.830998:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.831005:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.831034:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197588.831082:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:2360:x1875060755348992:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 281us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197588.831088:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00010000:00010000:0.0:1788197588.831268:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831285:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831313:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831318:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831324:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831329:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197588.831333:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831340:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831350:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:0.0:1788197588.831353:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788197588.831356:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.831362:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6800/0x167e6c2924030c4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197588.831402:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:11532:x1875060755348864:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 12114us (12680us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788197588.831409:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 185 00000100:00100000:0.0:1788197588.834178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.834252:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755349120 00000100:00100000:2.0:1788197588.834260:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755349120 00000100:00100000:2.0:1788197588.834354:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:2.0:1788197588.834364:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755349120:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788197588.834422:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.834506:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.834514:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197588.834518:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197588.834522:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.834566:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.834580:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 8 pid: 8021 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197588.834607:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875060776316928:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197588.834692:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197588.836658:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6698:1875060776316928:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197588.836685:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197588.838222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.841446:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755349248 00000100:00100000:3.0:1788197588.841465:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755349248 00010000:00010000:3.0:1788197588.841522:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 9 pid: 8021 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197588.841576:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:3.0:1788197588.841595:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2360:x1875060755349248:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197588.841614:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197588.841639:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 9 pid: 8021 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.841653:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 9 pid: 8021 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.841677:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030c39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a02 expref: 9 pid: 8021 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.841692:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788197588.841697:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788197588.841702:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.841730:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.841766:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197588.841864:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755349248:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 280us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.841871:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00010000:00010000:0.0:1788197588.841947:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.841959:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.841986:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.841995:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.842003:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.842010:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197588.842015:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.842023:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.842035:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.842054:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924030c55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197588.842123:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755349120:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 7760us (7954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197588.842132:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:3.0:1788197588.853710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.854164:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755349504 00000100:00100000:2.0:1788197588.854174:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755349504 00000100:00100000:2.0:1788197588.854220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 186 00000100:00100000:2.0:1788197588.854239:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+17:11532:x1875060755349504:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788197588.854307:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.854322:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.854333:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.854521:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.854712:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.854721:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.854755:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 18 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.854769:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 18 pid: 5871 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197588.854782:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605581500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776317056:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197588.856135:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197588.865060:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605581500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776317056:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197588.865096:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197588.874015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.874702:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755349632 00000100:00100000:3.0:1788197588.874715:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755349632 00010000:00010000:3.0:1788197588.874762:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 19 pid: 5871 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197588.874838:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 71 00000100:00100000:3.0:1788197588.874851:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:2360:x1875060755349632:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197588.874870:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197588.874877:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 19 pid: 5871 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.874892:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 19 pid: 5871 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.874916:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59ed expref: 19 pid: 5871 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.874935:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:3.0:1788197588.874949:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.874960:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.874969:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.875006:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197588.875058:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+18:2360:x1875060755349632:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 210us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197588.875065:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 71 00010000:00010000:0.0:1788197588.875483:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197588.875492:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788197588.875693:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788197588.875875:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788197588.876040:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788197588.876124:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875060776317184:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788197588.876192:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197588.876228:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197588.876242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776317184 00000100:00100000:1.0:1788197588.876248:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776317184 00000100:00100000:1.0:1788197588.876289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788197588.876297:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875060776317184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788197588.876363:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875060776317184:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197588.876369:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788197588.876663:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788197588.876668:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c605582680, transno 4294967315 00000100:00100000:1.0:1788197588.876683:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875060776317184:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788197588.877154:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788197588.877211:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875060776317312:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788197588.877256:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197588.877287:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197588.877330:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776317312 00000100:00100000:0.0:1788197588.877335:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776317312 00000100:00100000:0.0:1788197588.877364:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788197588.877371:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875060776317312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788197588.877515:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875060776317312:12345-0@lo:1000:mdt00_002.0 Request processed in 144us (258us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788197588.877521:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788197588.879899:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1875060776317312:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788197588.879944:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.879954:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.879961:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.879978:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197588.879984:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.879992:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880009:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7065f6e00) 00010000:00010000:1.0:1788197588.880012:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197588.880017:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880023:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030c63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880054:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880060:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880066:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880070:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197588.880073:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880078:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880097:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:1.0:1788197588.880099:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197588.880103:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880108:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030b98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880129:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880142:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880151:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880185:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.880199:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 21 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197588.880211:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776317440:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197588.880295:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197588.883703:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776317440:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197588.883734:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197588.886622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197588.886692:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755349760 00000100:00100000:3.0:1788197588.886703:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755349760 00010000:00010000:3.0:1788197588.886747:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 22 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197588.886787:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:3.0:1788197588.886797:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:2359:x1875060755349760:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197588.886815:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197588.886878:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 22 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.886893:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 22 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.886916:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030bb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d59d1 expref: 22 pid: 5841 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.886941:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:3.0:1788197588.886947:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.886956:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.886963:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197588.886995:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197588.887013:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887025:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887040:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887048:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887054:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887061:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfa00 already unused, calling callback (ffffffffc21fc4f0) 00000100:00100000:3.0:1788197588.887065:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:2359:x1875060755349760:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 266us (449us total) trans 0 rc 0/0 00010000:00010000:1.0:1788197588.887068:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197588.887078:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 72 00010000:00010000:1.0:1788197588.887080:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887093:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:1.0:1788197588.887097:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197588.887101:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887107:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887127:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887134:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887139:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887143:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197588.887146:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887153:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887161:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c7028a4200) 00010000:00010000:1.0:1788197588.887164:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788197588.887166:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.887172:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030c5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197588.887363:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11532:x1875060755349504:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 33125us (33662us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788197588.887381:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 186 00000020:00080000:1.0:1788197588.887385:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788197588.887700:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788197588.887705:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788197588.888374:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788197588.888383:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788197588.900807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197588.901057:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755350016 00000100:00100000:2.0:1788197588.901067:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755350016 00000100:00100000:2.0:1788197588.901293:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:2.0:1788197588.901305:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706343050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11532:x1875060755350016:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788197588.902717:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788197588.902818:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788197588.903074:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.903090:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.903101:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.903108:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.903114:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.903121:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197588.903307:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788197588.903417:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706343050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:11532:x1875060755350016:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 2111us (2616us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788197588.903428:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000020:00080000:2.0:1788197588.903434:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788197588.903622:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197588.903633:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.903640:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197588.903645:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.903653:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.903665:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93c7028a4500) 00010000:00010000:1.0:1788197588.903668:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788197588.903673:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.903679:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030c71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197588.903697:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197588.903699:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197588.903700:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788197589.046675:0:12528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788197589.046685:0:12528:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788197589.046737:0:12528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788197589.046744:0:12528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788197589.238189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197589.239059:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755350272 00000100:00100000:3.0:1788197589.239071:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755350272 00000100:00100000:3.0:1788197589.239133:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 187 00000100:00100000:3.0:1788197589.239144:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:11542:x1875060755350272:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197589.239168:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197589.239185:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a09 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.239273:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030c7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.239286:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030c7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.239296:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030c7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197589.239315:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788197589.239449:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a09 expref: 25 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.239465:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a09 expref: 24 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.239472:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197589.239475:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788197589.239478:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7c00, rc 0) 00000100:00100000:3.0:1788197589.239539:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11542:x1875060755350272:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 397us (1360us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788197589.239547:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 187 00000100:00100000:3.0:1788197589.243339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.243437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755350400 00000100:00100000:1.0:1788197589.243446:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755350400 00000100:00100000:1.0:1788197589.243505:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 188 00000100:00100000:1.0:1788197589.243517:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11542:x1875060755350400:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:1.0:1788197589.243610:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243628:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243640:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243666:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243674:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243680:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243935:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243945:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.243952:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788197589.244543:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244558:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244564:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244571:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244576:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfa00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197589.244580:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244607:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244620:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197589.244623:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197589.244628:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244635:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c2924030c8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244648:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244655:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244660:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244665:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197589.244668:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244673:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244680:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c704a46d00) 00010000:00010000:1.0:1788197589.244683:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197589.244686:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244702:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244716:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244722:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244728:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244733:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197589.244736:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244742:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244750:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c704a46c00) 00010000:00010000:1.0:1788197589.244752:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197589.244755:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.244761:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030c9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197589.246809:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11542:x1875060755350400:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 3283us (3469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197589.246847:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 188 00000100:00100000:2.0:1788197589.305986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197589.307551:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755350656 00000100:00100000:0.0:1788197589.307562:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755350656 00000100:00100000:0.0:1788197589.307907:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 189 00000100:00100000:0.0:1788197589.307920:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11545:x1875060755350656:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197589.307945:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197589.307969:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030ca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a10 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308065:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308083:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308096:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308113:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308121:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308129:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308702:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308719:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308727:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197589.308738:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788197589.308851:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308859:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308865:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308870:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197589.308874:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308882:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308894:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197589.308897:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197589.308902:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308908:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308919:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308932:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308938:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308943:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197589.308946:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308952:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308960:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c719ede800) 00010000:00010000:0.0:1788197589.308962:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197589.308965:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.308970:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.309013:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030ca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 27 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.309026:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 26 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.309033:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:0.0:1788197589.309035:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197589.309044:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031e00, rc 0) 00000100:00100000:0.0:1788197589.309120:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:11545:x1875060755350656:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1202us (3143us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788197589.309129:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 189 00000100:00100000:2.0:1788197589.315610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.315917:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755350784 00000100:00100000:1.0:1788197589.315926:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755350784 00000100:00100000:1.0:1788197589.315978:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 190 00000100:00100000:1.0:1788197589.315988:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:11545:x1875060755350784:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:1.0:1788197589.316047:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316063:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316074:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316096:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316103:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316110:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316116:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197589.316120:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316128:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316139:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:1.0:1788197589.316142:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197589.316147:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.316167:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030cc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197589.316225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:11545:x1875060755350784:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 238us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197589.316233:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 190 00000100:00100000:0.0:1788197589.322631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.322971:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755351040 00000100:00100000:1.0:1788197589.322981:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755351040 00000100:00100000:1.0:1788197589.323040:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:1.0:1788197589.323049:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:11545:x1875060755351040:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197589.323310:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:11545:x1875060755351040:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 261us (687us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788197589.323319:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:2.0:1788197589.385306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.389373:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755351296 00000100:00100000:1.0:1788197589.389390:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755351296 00000100:00100000:1.0:1788197589.389464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 191 00000100:00100000:1.0:1788197589.389475:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:11079:x1875060755351296:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:1.0:1788197589.389504:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197589.389527:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030ccc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a17 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.389651:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.389665:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 28 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.389695:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.389728:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 28 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.389743:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 28 pid: 5871 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197589.389756:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70838ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776317568:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197589.389897:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197589.404942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197589.405041:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755351424 00000100:00100000:3.0:1788197589.405051:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755351424 00010000:00010000:3.0:1788197589.405091:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 29 pid: 5871 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197589.405133:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:3.0:1788197589.405154:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:2359:x1875060755351424:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197589.405168:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197589.405175:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 29 pid: 5871 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.405188:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 29 pid: 5871 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.405225:0:8468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:3.0:1788197589.405231:0:8468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.405240:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.405246:0:8468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.405264:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197589.405320:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+29:2359:x1875060755351424:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 177us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197589.405328:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 73 00010000:00010000:1.0:1788197589.411106:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a10 expref: 28 pid: 5871 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197589.411134:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70838ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776317568:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197589.411173:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.411344:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.411351:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197589.411381:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788197589.411530:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030ccc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.411545:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.411554:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:2.0:1788197589.411556:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788197589.411560:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf800, rc 0) 00000100:00100000:2.0:1788197589.411741:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:11079:x1875060755351296:12345-192.168.206.40@tcp:101:bash.0 Request processed in 22265us (26442us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788197589.411750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 191 00000100:00100000:2.0:1788197589.415905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197589.416070:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755351680 00000100:00100000:3.0:1788197589.416080:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755351680 00000100:00100000:3.0:1788197589.416152:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 192 00000100:00100000:3.0:1788197589.416162:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:11079:x1875060755351680:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:3.0:1788197589.416430:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.416446:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.416457:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788197589.416513:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788197589.416537:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f7d0f1c reply state 00000000e0956186 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197589.416554:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788197589.416617:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788197589.416707:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11079:x1875060755351680:12345-192.168.206.40@tcp:36:bash.0 Request processed in 545us (813us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788197589.416715:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 192 00000020:00080000:3.0:1788197589.416720:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788197589.419236:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.419256:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.419263:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.419269:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197589.419289:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.419297:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.419313:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:1.0:1788197589.419316:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197589.419320:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.419327:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030ce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197589.433067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197589.435610:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755351808 00000100:00100000:0.0:1788197589.435626:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755351808 00000100:00100000:0.0:1788197589.435697:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 193 00000100:00100000:0.0:1788197589.435708:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:11079:x1875060755351808:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197589.435733:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197589.435751:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ce8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a1e expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.435810:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a1e expref: 32 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.435865:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a1e expref: 32 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.435886:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:0.0:1788197589.435890:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788197589.435894:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030e00, rc 0) 00000100:00100000:0.0:1788197589.435951:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11079:x1875060755351808:12345-192.168.206.40@tcp:101:bash.0 Request processed in 245us (2895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197589.435959:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 193 00000100:00100000:0.0:1788197589.447621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197589.448186:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755351936 00000100:00100000:3.0:1788197589.448196:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755351936 00000100:00100000:3.0:1788197589.448261:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:3.0:1788197589.448272:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:11079:x1875060755351936:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1788197589.448287:0:8021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197589.448307:0:8021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a25 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197589.448344:0:8021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a95bad3, atime: 0x6a95bad2, ctime: 0x6a95bad3, blocks: 0xb 00010000:00010000:3.0:1788197589.448374:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:3.0:1788197589.448379:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197589.448388:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.448406:0:8021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.448418:0:8021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6200, rc 0) 00000100:00100000:3.0:1788197589.448479:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:11079:x1875060755351936:12345-192.168.206.40@tcp:101:bash.0 Request processed in 209us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197589.448503:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:3.0:1788197589.452694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.452763:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755352064 00000100:00100000:1.0:1788197589.452774:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755352064 00002000:00010000:1.0:1788197589.452815:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788197589.452854:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c73b8f6d80 with x1875060755352064 ext(0->18446744073709551615) 00002000:00010000:1.0:1788197589.452867:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c73b8f6d80. 00000100:00100000:1.0:1788197589.452891:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1788197589.452901:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755352064:12345-192.168.206.40@tcp:10:bash.0 00002000:00010000:1.0:1788197589.454039:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788197589.454045:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788197587 -> 1788197589 00002000:00010000:1.0:1788197589.454048:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788197586 -> 1788197586 00002000:00010000:1.0:1788197589.454050:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788197587 -> 1788197589 00002000:00010000:1.0:1788197589.454052:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788197589.454112:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2360:x1875060755352064:12345-192.168.206.40@tcp:10:bash.0 Request processed in 1209us (1425us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788197589.454121:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00002000:00010000:1.0:1788197589.454759:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788197589.454765:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c73b8f6d80 with x1875060755352064 ext(0->18446744073709551615) 00002000:00010000:1.0:1788197589.454773:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c73b8f6d80. 00000100:00100000:1.0:1788197589.571597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197589.571757:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755352192 00000100:00100000:3.0:1788197589.571770:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755352192 00000100:00100000:3.0:1788197589.571861:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 194 00000100:00100000:3.0:1788197589.571873:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11559:x1875060755352192:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:3.0:1788197589.571949:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.571965:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.571976:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.571992:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.571999:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572005:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572268:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572278:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572284:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788197589.572327:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572338:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572344:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572350:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572354:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197589.572358:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572495:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572510:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197589.572513:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197589.572518:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572524:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030cf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572537:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572543:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572555:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572561:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197589.572564:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572571:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572579:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7065f6d00) 00010000:00010000:3.0:1788197589.572595:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197589.572599:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572605:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572619:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572626:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572631:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572636:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197589.572638:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572654:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572662:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:3.0:1788197589.572665:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197589.572668:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.572674:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030d04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197589.572764:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11559:x1875060755352192:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 891us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197589.572773:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 194 00010000:00010000:3.0:1788197589.614239:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197589.651557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197589.651851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755352448 00000100:00100000:2.0:1788197589.651862:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755352448 00000100:00100000:2.0:1788197589.651927:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 195 00000100:00100000:2.0:1788197589.651938:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11562:x1875060755352448:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197589.651958:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197589.651980:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030d0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a2c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652059:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652075:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652098:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652146:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652155:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652161:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652417:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652428:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.652444:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197589.652455:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788197589.652558:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653020:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653028:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653033:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197589.653037:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653044:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653056:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197589.653059:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197589.653063:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653068:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653083:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653088:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653103:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653108:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197589.653111:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653117:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653126:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4800) 00010000:00010000:2.0:1788197589.653128:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197589.653273:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653281:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653328:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c800/0x167e6c2924030d0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a2c expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653342:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a2c expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.653351:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:2.0:1788197589.653353:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788197589.653356:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d400, rc 0) 00000100:00100000:2.0:1788197589.653421:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11562:x1875060755352448:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1484us (1873us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788197589.653438:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 195 00000100:00100000:0.0:1788197589.658002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.658165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755352576 00000100:00100000:1.0:1788197589.658175:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755352576 00000100:00100000:1.0:1788197589.658235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:1.0:1788197589.658245:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11562:x1875060755352576:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:1.0:1788197589.658305:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.658321:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.658331:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.658362:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.658387:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 34 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197589.658400:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776317696:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197589.658478:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197589.664117:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776317696:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197589.664148:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197589.666340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.666566:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755352832 00000100:00100000:1.0:1788197589.666575:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755352832 00000100:00100000:1.0:1788197589.666653:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:1.0:1788197589.666663:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:5597:x1875060755352832:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788197589.667031:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:5597:x1875060755352832:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 367us (698us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788197589.667039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:1.0:1788197589.670948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197589.671074:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755352960 00000100:00100000:2.0:1788197589.671083:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755352960 00010000:00010000:2.0:1788197589.671126:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 36 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197589.671167:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 74 00000100:00100000:2.0:1788197589.671177:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:2360:x1875060755352960:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197589.671191:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197589.671197:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 36 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.671210:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 36 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.671232:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf800/0x167e6c2924030cd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a17 expref: 36 pid: 5842 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.671247:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:2.0:1788197589.671251:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.671260:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.671268:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.671323:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197589.671377:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:2360:x1875060755352960:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 201us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197589.671384:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 74 00010000:00010000:0.0:1788197589.671545:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671553:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671595:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671603:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671609:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671624:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197589.671628:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671635:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671645:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:0.0:1788197589.671647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197589.671651:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.671657:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030d2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197589.671707:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11562:x1875060755352576:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 13463us (13714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197589.671725:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 196 00000100:00100000:0.0:1788197589.676452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.678182:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755353216 00000100:00100000:1.0:1788197589.678196:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755353216 00000100:00100000:1.0:1788197589.678267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:1.0:1788197589.678278:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+34:11562:x1875060755353216:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197589.678525:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:11562:x1875060755353216:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 248us (2084us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788197589.678533:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:1.0:1788197589.783867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197589.784096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755353472 00000100:00100000:2.0:1788197589.784106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755353472 00000100:00100000:2.0:1788197589.784170:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 197 00000100:00100000:2.0:1788197589.784180:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+35:11573:x1875060755353472:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:2.0:1788197589.784204:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197589.784225:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a33 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784330:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784346:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784358:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784373:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784380:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784387:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784683:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784693:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784700:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197589.784710:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788197589.784810:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784818:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784862:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784867:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197589.784872:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784880:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784892:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197589.784895:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197589.784900:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784918:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784934:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784939:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784945:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784950:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197589.784953:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784959:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784967:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4800) 00010000:00010000:2.0:1788197589.784969:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197589.784972:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.784977:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.785027:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a33 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.785040:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a33 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.785054:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:2.0:1788197589.785056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197589.785058:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c200, rc 0) 00000100:00100000:2.0:1788197589.785128:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:11573:x1875060755353472:12345-192.168.206.40@tcp:101:cat.0 Request processed in 949us (1311us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788197589.785135:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 197 00000100:00100000:0.0:1788197589.789714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.789805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755353728 00000100:00100000:1.0:1788197589.789815:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755353728 00000100:00100000:1.0:1788197589.789902:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:1.0:1788197589.789912:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:11573:x1875060755353728:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:1.0:1788197589.790135:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:11573:x1875060755353728:12345-192.168.206.40@tcp:35:cat.0 Request processed in 223us (429us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788197589.790143:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 54 00000100:00100000:1.0:1788197589.815495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197589.819044:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755353984 00000100:00100000:0.0:1788197589.819060:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755353984 00000100:00100000:0.0:1788197589.819210:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 198 00000100:00100000:0.0:1788197589.819223:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:11574:x1875060755353984:12345-192.168.206.40@tcp:36:rm.0 00010000:00010000:0.0:1788197589.819281:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788197589.819307:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a33 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819332:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a2c expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819343:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a1e expref: 36 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819352:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719edeb00) 00010000:00010000:0.0:1788197589.819377:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197589.819400:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819413:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819422:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819453:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819460:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819467:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819717:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819726:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.819732:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788197589.822081:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788197589.822095:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385968272261ns, next at 386968268367ns, rc = 0 00010000:00010000:0.0:1788197589.822170:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822185:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822196:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822205:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822223:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822230:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822268:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788197589.822290:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822296:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822302:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822307:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197589.822313:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822320:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822332:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719ede700) 00010000:00010000:0.0:1788197589.822335:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788197589.822339:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822345:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030d66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822365:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822376:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822382:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822387:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197589.822390:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822395:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822403:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197589.822405:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197589.822407:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.822413:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030d58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788197589.822422:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e03da84 reply state 0000000088fc3441 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197589.822430:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788197589.822510:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+37:11574:x1875060755353984:12345-192.168.206.40@tcp:36:rm.0 Request processed in 3288us (7021us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788197589.822519:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 198 00010000:00010000:1.0:1788197589.825985:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197589.826000:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.826010:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197589.826015:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.826045:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.826066:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93c719ede700) 00010000:00010000:1.0:1788197589.826069:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788197589.826075:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.826083:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030d6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197589.826114:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197589.826117:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197589.826119:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197589.830170:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.830207:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.830214:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.830219:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197589.830224:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.830231:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.830247:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c719ede800) 00010000:00010000:0.0:1788197589.830251:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197589.830255:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.830261:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030d5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197589.870214:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776318208:0@lo:400:kworker.0 00000100:00100000:3.0:1788197589.870294:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197589.870381:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788197589.870388:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776317824:0@lo:400:kworker.0 00000100:00100000:3.0:1788197589.870417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197589.870445:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776318336:0@lo:400:kworker.0 00000100:00100000:3.0:1788197589.870473:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197589.870512:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776317824 00000100:00100000:3.0:1788197589.870535:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776317824 00000100:00100000:3.0:1788197589.870611:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788197589.870620:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776317824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197589.870692:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3313:x1875060776317824:12345-0@lo:400:kworker.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197589.870700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788197589.870757:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776317824:0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871231:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776318080:0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871265:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197589.871298:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788197589.871304:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776317952:0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871326:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197589.871342:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776318464:0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197589.871414:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776318208 00000100:00100000:2.0:1788197589.871417:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776318208 00000100:00100000:2.0:1788197589.871447:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776318464 00000100:00100000:2.0:1788197589.871451:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776318464 00000100:00100000:2.0:1788197589.871467:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788197589.871474:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776318208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871509:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776318208:12345-0@lo:400:kworker.0 Request processed in 35us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197589.871515:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788197589.871527:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788197589.871532:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776318464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871576:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776318464:12345-0@lo:400:kworker.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197589.871601:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788197589.871635:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776318464:0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871666:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776318336 00000100:00100000:2.0:1788197589.871670:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776318336 00000100:00080000:2.0:1788197589.871690:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197589.871711:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788197589.871717:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776318336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.871750:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776318336:12345-0@lo:400:kworker.0 Request processed in 34us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197589.871756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788197589.871765:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776318080 00000100:00100000:2.0:1788197589.871768:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776318080 00000100:00080000:2.0:1788197589.872011:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197589.872029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776317952 00000100:00100000:2.0:1788197589.872033:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776317952 00000100:00100000:2.0:1788197589.872048:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788197589.872053:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776318080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.872088:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776318080:12345-0@lo:400:kworker.0 Request processed in 34us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197589.872093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788197589.872116:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776318080:0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.872137:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788197589.872144:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776317952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197589.872176:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776317952:12345-0@lo:400:kworker.0 Request processed in 33us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197589.872182:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788197589.872214:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776317952:0@lo:400:kworker.0 00000100:00100000:3.0:1788197589.875865:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776318336:0@lo:400:kworker.0 00000100:00100000:3.0:1788197589.875890:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776318208:0@lo:400:kworker.0 00000100:00100000:1.0:1788197589.891180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197589.891359:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755354240 00000100:00100000:2.0:1788197589.891378:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755354240 00000100:00100000:2.0:1788197589.891446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 199 00000100:00100000:2.0:1788197589.891456:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+36:11580:x1875060755354240:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197589.891481:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197589.891506:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a3a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.892142:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.892157:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.892169:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.892184:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.892191:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.892196:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788197589.894058:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788197589.894244:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894271:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894281:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894314:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894321:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894327:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894333:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197589.894337:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894357:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894374:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197589.894377:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197589.894381:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894388:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030d7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197589.894401:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dacb073 reply state 0000000087505308 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197589.894432:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788197589.894465:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030d74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894480:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.894488:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4100) 00010000:00010000:2.0:1788197589.894490:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197589.894492:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197589.894587:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+39:11580:x1875060755354240:12345-192.168.206.40@tcp:101:bash.0 Request processed in 3123us (3407us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788197589.894596:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 199 00000100:00100000:1.0:1788197589.899125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197589.899224:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755354368 00000100:00100000:3.0:1788197589.899233:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755354368 00000100:00100000:3.0:1788197589.899290:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:3.0:1788197589.899305:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755354368:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1788197589.899322:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197589.899343:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a41 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.899349:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.899362:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.899371:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197589.899376:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788197589.899377:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197589.899398:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1788197589.899400:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.899405:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197589.899414:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.899419:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.899435:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4800) 00010000:00010000:0.0:1788197589.899440:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197589.899448:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.899448:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197589.899468:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030d82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.899489:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6e00, rc 0) 00000100:00100000:3.0:1788197589.899552:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2357:x1875060755354368:12345-192.168.206.40@tcp:101:bash.0 Request processed in 253us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197589.899559:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:1.0:1788197589.904296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197589.904373:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755354496 00000100:00100000:2.0:1788197589.904381:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755354496 00000100:00100000:2.0:1788197589.904436:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:2.0:1788197589.904446:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:11580:x1875060755354496:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197589.904466:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197589.904485:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a48 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.904538:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.904548:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197589.904552:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197589.904563:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.904608:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.904632:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 7 pid: 6699 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197589.904646:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776318592:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197589.904723:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2dbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197589.908292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197589.908391:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6698:1875060776318592:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197589.908424:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197589.908444:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c400, rc 0) 00000100:00100000:2.0:1788197589.908505:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:11580:x1875060755354496:12345-192.168.206.40@tcp:101:bash.0 Request processed in 4060us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197589.908515:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:3.0:1788197589.908724:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755354624 00000100:00100000:3.0:1788197589.908731:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755354624 00010000:00010000:3.0:1788197589.908762:0:8468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 7 pid: 6699 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197589.908794:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:3.0:1788197589.908802:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755354624:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197589.908815:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197589.908871:0:8468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 7 pid: 6699 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.908884:0:8468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 7 pid: 6699 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.908906:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000106438c3/0x167e6c2924030d97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a41 expref: 7 pid: 6699 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.908919:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197589.908923:0:8468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197589.908931:0:8468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.908955:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197589.908986:0:8468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197589.909000:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1875060776318720:192.168.206.40@tcp:105: 00000100:00100000:3.0:1788197589.909052:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add840 going to sleep for 11 seconds 00000100:00100000:0.0:1788197589.915672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197589.915805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755354880 00000100:00100000:1.0:1788197589.915815:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755354880 00000100:00100000:1.0:1788197589.915913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:1.0:1788197589.915924:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+38:11580:x1875060755354880:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:1.0:1788197589.916273:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+39:11580:x1875060755354880:12345-192.168.206.40@tcp:35:bash.0 Request processed in 350us (608us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788197589.916281:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 55 00000100:00100000:3.0:1788197589.917401:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8468:1875060776318720:192.168.206.40@tcp:105: 00010000:00010000:3.0:1788197589.917424:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197589.917551:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2359:x1875060755354624:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 8748us (9266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197589.917561:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:0.0:1788197590.112974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197590.115217:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755355008 00000100:00100000:3.0:1788197590.115231:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755355008 00000100:00100000:3.0:1788197590.115394:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 200 00000100:00100000:3.0:1788197590.115409:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+39:11596:x1875060755355008:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197590.115432:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197590.115454:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a4f expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.115523:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.115537:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.115575:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197590.115623:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788197590.115627:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197590.115644:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.115670:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a4f expref: 41 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.115689:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a4f expref: 40 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.115712:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197590.115715:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197590.115718:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7e00, rc 0) 00000100:00100000:3.0:1788197590.115796:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:11596:x1875060755355008:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 392us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197590.115804:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 200 00000100:00080000:2.0:1788197590.118908:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197590.121254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.121346:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755355264 00000100:00100000:0.0:1788197590.121356:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755355264 00000100:00100000:0.0:1788197590.121413:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 201 00000100:00100000:0.0:1788197590.121424:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+40:11596:x1875060755355264:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197590.121444:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197590.121463:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a56 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.121592:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.121606:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.121628:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197590.121640:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788197590.121759:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a56 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.121942:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a56 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.121953:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4100) 00010000:00010000:0.0:1788197590.121956:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197590.121959:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030e00, rc 0) 00000100:00100000:1.0:1788197590.122538:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+42:11596:x1875060755355264:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1113us (1291us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788197590.122548:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 201 00000100:00100000:1.0:1788197590.126360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197590.126493:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755355520 00000100:00100000:3.0:1788197590.126504:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755355520 00000100:00100000:3.0:1788197590.126606:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 202 00000100:00100000:3.0:1788197590.126618:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+42:11596:x1875060755355520:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197590.126642:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197590.126663:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030dc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a5d expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.126787:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030dcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.126802:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.126814:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197590.126855:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788197590.127168:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030dc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a5d expref: 45 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.127187:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a5d expref: 44 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.127196:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4100) 00010000:00010000:3.0:1788197590.127199:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788197590.127203:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6a00, rc 0) 00000100:00100000:3.0:1788197590.127267:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+44:11596:x1875060755355520:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 650us (915us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788197590.127275:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 202 00000100:00100000:1.0:1788197590.131981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197590.132042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197590.132175:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755355776 00000100:00100000:3.0:1788197590.132185:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755355776 00000100:00100000:3.0:1788197590.132250:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:3.0:1788197590.132261:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740cf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+6:2360:x1875060755355776:12345-192.168.206.40@tcp:1:lfs.0 00010000:00010000:3.0:1788197590.132305:0:8021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.132338:0:8021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.132346:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197590.132349:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788197590.132354:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.132387:0:8021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.132401:0:8021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 6 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197590.132416:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8021:1875060776318848:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197590.132499:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736add540 going to sleep for 11 seconds 00000100:00100000:2.0:1788197590.132620:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755355648 00000100:00100000:2.0:1788197590.132626:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755355648 00000100:00100000:2.0:1788197590.132670:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:2.0:1788197590.132678:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+44:2360:x1875060755355648:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197590.132688:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197590.132707:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a56 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.132731:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4100) 00010000:00010000:2.0:1788197590.132736:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197590.132761:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+43:2360:x1875060755355648:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 84us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.132769:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00080000:1.0:1788197590.133099:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197590.135474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.135565:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755355904 00000100:00100000:2.0:1788197590.135574:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755355904 00002000:00100000:2.0:1788197590.135627:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93c741798e00 x1875060755355904/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:486/0 lens 504/0 e 0 to 0 dl 1788197601 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788197590.135638:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741798e00 with x1875060755355904 ext(0->8) 00010000:00010000:2.0:1788197590.135647:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 7 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.135662:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 7 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197590.135670:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c741798e00 00000100:00100000:2.0:1788197590.135702:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:2.0:1788197590.135712:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755355904:12345-192.168.206.40@tcp:4:lfs.0 00000100:00100000:2.0:1788197590.136519:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755355904:12345-192.168.206.40@tcp:4:lfs.0 Request processed in 804us (1051us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788197590.136527:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00002000:00100000:2.0:1788197590.136536:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93c741798e00 x1875060755355904/t4294967308(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:486/0 lens 504/448 e 0 to 0 dl 1788197601 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788197590.136560:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741798e00 with x1875060755355904 ext(0->8) 00010000:00010000:2.0:1788197590.136566:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.136592:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197590.136599:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93c741798e00 00000100:00100000:3.0:1788197590.136981:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8021:1875060776318848:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197590.137017:0:8021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197590.144474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.144559:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755356032 00000100:00100000:2.0:1788197590.144570:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755356032 00010000:00010000:2.0:1788197590.144617:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197590.144663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:2.0:1788197590.144674:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2357:x1875060755356032:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197590.144688:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788197590.144715:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788197590.144718:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788197589 00002000:00010000:2.0:1788197590.144720:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788197589 00002000:00010000:2.0:1788197590.144722:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788197589 00010000:00010000:2.0:1788197590.144728:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.144742:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.144785:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924030d9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a48 expref: 9 pid: 6698 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.144803:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197590.144808:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197590.144814:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.144867:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.144896:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197590.144949:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2357:x1875060755356032:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 277us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.144958:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00010000:00010000:0.0:1788197590.145042:0:8021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145054:0:8021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145081:0:8021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145089:0:8021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145097:0:8021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145115:0:8021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197590.145120:0:8021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145128:0:8021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145139:0:8021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.145147:0:8021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb5694c1/0x167e6c2924030ddd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197590.145192:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740cf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755355776:12345-192.168.206.40@tcp:1:lfs.0 Request processed in 12934us (13149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197590.145200:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:2.0:1788197590.153228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197590.153430:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755356288 00000100:00100000:1.0:1788197590.153441:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755356288 00000100:00100000:1.0:1788197590.153496:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 56 00000100:00100000:1.0:1788197590.153506:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706341450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+43:11596:x1875060755356288:12345-192.168.206.40@tcp:35:lfs.0 00000004:00010000:1.0:1788197590.153593:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a5d expref: 43 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788197590.153915:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788197590.153961:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788197590.154493:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788197590.154548:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.154563:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.154571:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.154618:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.154634:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 47 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197590.154668:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741798700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776318976:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197590.154760:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788197590.157297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.157391:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741798700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1875060776318976:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197590.157418:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197590.157490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755356416 00000100:00100000:3.0:1788197590.157497:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755356416 00010000:00010000:3.0:1788197590.157531:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 48 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197590.157596:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:3.0:1788197590.157605:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+48:2360:x1875060755356416:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197590.157619:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197590.157626:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 48 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.157638:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 48 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.157659:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a3a expref: 48 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.157677:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4100) 00010000:00010000:3.0:1788197590.157682:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.157691:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.157698:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.157724:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197590.157768:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+47:2360:x1875060755356416:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 165us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197590.157785:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00010000:00010000:2.0:1788197590.158212:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.158221:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197590.158334:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788197590.158571:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788197590.158698:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d26a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776319104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788197590.158752:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197590.159128:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197590.160630:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776319104 00000100:00100000:0.0:1788197590.160643:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776319104 00000100:00100000:1.0:1788197590.161549:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788197590.161561:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875060776319104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788197590.161708:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875060776319104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 150us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197590.161715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788197590.162232:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788197590.162302:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d26a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776319104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788197590.163318:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788197590.163422:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776319232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788197590.163493:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197590.163540:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736adde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197590.163708:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776319232 00000100:00100000:1.0:1788197590.163715:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776319232 00000100:00100000:1.0:1788197590.163761:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788197590.163769:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875060776319232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788197590.164343:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1875060776319232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 572us (848us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788197590.164351:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788197590.164731:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1875060776319232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788197590.165151:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788197590.165201:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.165212:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.165220:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.165226:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197590.165230:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.165238:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.165254:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4100) 00010000:00010000:3.0:1788197590.165257:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788197590.165261:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.165267:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030de4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788197590.165471:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788197590.165718:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788197590.165729:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386311905785ns, next at 387311903592ns, rc = 0 00000001:00080000:3.0:1788197590.165736:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788197590.165768:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4100) 00010000:00010000:3.0:1788197590.165771:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788197590.166097:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030dcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a5d expref: 51 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197590.166245:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706341450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+50:11596:x1875060755356288:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 12739us (13026us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788197590.166254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 56 00000020:00080000:3.0:1788197590.166259:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788197590.171565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.172460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755356544 00000100:00100000:2.0:1788197590.172472:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755356544 00000100:00100000:2.0:1788197590.172534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 203 00000100:00100000:2.0:1788197590.172633:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+50:11596:x1875060755356544:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197590.172655:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197590.172677:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030deb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a64 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.174329:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a64 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.174355:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030deb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a64 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.174382:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.174385:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197590.174389:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c400, rc 0) 00000100:00100000:2.0:1788197590.174458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:11596:x1875060755356544:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1829us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.174467:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 203 00000100:00100000:1.0:1788197590.178407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.178510:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755356800 00000100:00100000:2.0:1788197590.178521:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755356800 00000100:00100000:2.0:1788197590.178593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:2.0:1788197590.178605:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+51:11596:x1875060755356800:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:3.0:1788197590.179328:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11596:x1875060755356800:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 721us (930us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788197590.179338:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 57 00000100:00100000:3.0:1788197590.258995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.260890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755356928 00000100:00100000:0.0:1788197590.260904:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755356928 00000100:00100000:0.0:1788197590.260975:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 204 00000100:00100000:0.0:1788197590.260985:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11606:x1875060755356928:12345-192.168.206.40@tcp:34:lfs.0 00010000:00010000:0.0:1788197590.261059:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261088:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261100:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261114:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261122:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261128:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261228:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261237:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261244:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788197590.261283:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261296:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261303:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261321:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261327:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197590.261331:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261339:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261352:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197590.261355:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197590.261360:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261366:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261379:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261385:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261390:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261394:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197590.261397:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261411:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261419:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c719ede800) 00010000:00010000:0.0:1788197590.261421:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197590.261424:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261429:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261441:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261446:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261451:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261456:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197590.261459:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261464:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261471:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:0.0:1788197590.261473:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197590.261475:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.261490:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197590.261605:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11606:x1875060755356928:12345-192.168.206.40@tcp:34:lfs.0 Request processed in 619us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197590.261613:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 204 00000100:00100000:0.0:1788197590.340384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197590.340525:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755357184 00000100:00100000:1.0:1788197590.340535:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755357184 00000100:00100000:1.0:1788197590.340606:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 205 00000100:00100000:1.0:1788197590.340618:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+52:11609:x1875060755357184:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197590.340640:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197590.340672:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a6b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.340849:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.340881:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.340893:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.340909:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.340916:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.340923:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341040:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341048:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341055:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197590.341064:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788197590.341147:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341167:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341173:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341185:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197590.341189:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341197:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341210:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197590.341214:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197590.341218:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341224:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030e0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341237:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341242:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341248:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341253:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197590.341256:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341261:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341277:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c704a46c00) 00010000:00010000:1.0:1788197590.341279:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197590.341282:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341289:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c2924030e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a6b expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341337:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a6b expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.341343:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:1.0:1788197590.341346:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197590.341348:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfe00, rc 0) 00000100:00100000:1.0:1788197590.341410:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:11609:x1875060755357184:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 795us (1035us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788197590.341417:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 205 00000100:00100000:1.0:1788197590.347930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.348424:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755357312 00000100:00100000:0.0:1788197590.348436:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755357312 00000100:00100000:0.0:1788197590.348501:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:0.0:1788197590.348512:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:11609:x1875060755357312:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:0.0:1788197590.348590:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348606:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348617:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348643:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348660:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348667:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348673:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197590.348691:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348699:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348956:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:0.0:1788197590.348959:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197590.348964:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.348972:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197590.349047:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:11609:x1875060755357312:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 537us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197590.349056:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 206 00000100:00100000:3.0:1788197590.367995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.369844:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755357568 00000100:00100000:2.0:1788197590.369861:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755357568 00000100:00100000:2.0:1788197590.370042:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1788197590.370054:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+54:11609:x1875060755357568:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197590.370304:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:11609:x1875060755357568:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 252us (2318us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788197590.370312:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 58 00000100:00100000:2.0:1788197590.381985:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776319360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197590.382058:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197590.382931:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776319360 00000100:00100000:3.0:1788197590.382941:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776319360 00000100:00100000:3.0:1788197590.383004:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788197590.383015:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776319360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197590.383040:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197590.394886:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776319360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11859us (12815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197590.394900:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788197590.395063:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776319360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197590.473331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.473498:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755357824 00000100:00100000:0.0:1788197590.473510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755357824 00000100:00100000:0.0:1788197590.474321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 207 00000100:00100000:0.0:1788197590.474332:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+55:11619:x1875060755357824:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:0.0:1788197590.474590:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197590.474594:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788197590.474621:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7e00/0x167e6c2924030dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a4f expref: 55 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.474776:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197590.474782:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788197590.474799:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.475043:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.475056:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.475067:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197590.475077:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788197590.475200:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a72 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.475216:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a72 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.475224:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:0.0:1788197590.475228:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788197590.475230:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030a00, rc 0) 00000100:00100000:0.0:1788197590.475307:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11619:x1875060755357824:12345-192.168.206.40@tcp:101:bash.0 Request processed in 976us (1983us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788197590.475315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 207 00000100:00100000:1.0:1788197590.482206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197590.482448:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755358080 00000100:00100000:3.0:1788197590.482460:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755358080 00000100:00100000:3.0:1788197590.482561:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 208 00000100:00100000:3.0:1788197590.482572:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11619:x1875060755358080:12345-192.168.206.40@tcp:36:bash.0 00010000:00010000:3.0:1788197590.482642:0:5871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788197590.482668:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a72 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.482690:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a6b expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.482701:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:3.0:1788197590.482705:0:5871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197590.482954:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.482966:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197590.482976:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788197590.483030:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788197590.483068:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007efe27a2 reply state 00000000db4b98eb transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197590.483077:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788197590.483177:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11619:x1875060755358080:12345-192.168.206.40@tcp:36:bash.0 Request processed in 606us (983us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788197590.483185:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 208 00000020:00080000:3.0:1788197590.483204:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788197590.504341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:0.0:1788197590.504536:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.504560:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.504567:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.504601:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197590.504607:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.504614:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.504630:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:0.0:1788197590.504633:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197590.504637:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.504643:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030e46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197590.504738:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755358208 00000100:00100000:2.0:1788197590.504748:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755358208 00000100:00100000:2.0:1788197590.504809:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 209 00000100:00100000:2.0:1788197590.504842:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+56:11619:x1875060755358208:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197590.504870:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197590.504893:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a79 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.504974:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.504996:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.505006:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197590.505057:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788197590.505061:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197590.505080:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.505105:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.505121:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.505128:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.505131:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197590.505133:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155da00, rc 0) 00000100:00100000:2.0:1788197590.505187:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11619:x1875060755358208:12345-192.168.206.40@tcp:101:bash.0 Request processed in 369us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.505194:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 209 00000100:00100000:1.0:1788197590.510143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197590.510228:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755358464 00000100:00100000:3.0:1788197590.510237:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755358464 00000100:00100000:3.0:1788197590.510322:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:3.0:1788197590.510333:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7368ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+57:11619:x1875060755358464:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:3.0:1788197590.510562:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7368ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11619:x1875060755358464:12345-192.168.206.40@tcp:35:bash.0 Request processed in 231us (429us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788197590.510570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 59 00000100:00100000:1.0:1788197590.580033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.580306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755358592 00000100:00100000:0.0:1788197590.580316:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755358592 00000100:00100000:0.0:1788197590.580381:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:0.0:1788197590.580391:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+58:11625:x1875060755358592:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197590.580418:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197590.580440:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a80 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.580503:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.580516:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.580527:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197590.580597:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788197590.580601:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197590.580617:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.580641:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a80 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.580659:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a80 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.580668:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197590.580670:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197590.580674:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031e00, rc 0) 00000100:00100000:0.0:1788197590.581251:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11625:x1875060755358592:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 858us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197590.581258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 210 00000100:00100000:1.0:1788197590.592478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.592604:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755358720 00000100:00100000:2.0:1788197590.592615:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755358720 00000100:00100000:2.0:1788197590.592675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:2.0:1788197590.592684:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11625:x1875060755358720:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197590.592701:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197590.592743:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a87 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592803:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592849:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592862:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592877:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592885:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592890:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592976:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592985:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.592992:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197590.593021:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788197590.593024:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197590.593038:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593049:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593068:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593074:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593080:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593085:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197590.593089:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593097:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593109:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197590.593111:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197590.593116:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593122:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d600/0x167e6c2924030e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593136:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593143:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593149:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593161:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197590.593164:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593170:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593178:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c7028a4900) 00010000:00010000:2.0:1788197590.593180:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197590.593183:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593189:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d000/0x167e6c2924030e77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593218:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a87 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593230:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a87 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.593236:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.593238:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197590.593240:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197590.593382:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11625:x1875060755358720:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 699us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.593389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 211 00000100:00100000:1.0:1788197590.602308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197590.602404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.602496:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755359104 00000100:00100000:2.0:1788197590.602520:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755359104 00000100:00100000:2.0:1788197590.602600:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:2.0:1788197590.602611:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:2360:x1875060755359104:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197590.602626:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197590.602652:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a87 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.602676:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.602681:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197590.602775:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:2360:x1875060755359104:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 165us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.602784:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:0.0:1788197590.604453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755358976 00000100:00100000:0.0:1788197590.604465:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755358976 00000100:00100000:0.0:1788197590.604569:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:0.0:1788197590.604591:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11625:x1875060755358976:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197590.604613:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197590.604632:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a8e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.605126:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.605162:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.605170:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.605210:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.605224:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 60 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197590.605238:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c740ffaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776319488:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197590.605344:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788197590.609484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.609686:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c740ffaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1875060776319488:192.168.206.40@tcp:104: 00010000:00010000:0.0:1788197590.609739:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197590.611427:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755359232 00000100:00100000:3.0:1788197590.611441:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755359232 00010000:00010000:2.0:1788197590.611555:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 61 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197590.611598:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:2.0:1788197590.611608:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:2359:x1875060755359232:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197590.611622:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197590.611629:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 61 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.611643:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 61 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.611662:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030e54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a79 expref: 61 pid: 5843 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.611698:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.611703:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.612018:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.612025:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.612047:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197590.612101:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:2359:x1875060755359232:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 494us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.612109:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 78 00010000:00010000:1.0:1788197590.612279:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.612286:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197590.612302:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788197590.612429:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030e85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.612444:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197590.612452:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:1.0:1788197590.612455:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788197590.612458:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030e00, rc 0) 00000100:00100000:1.0:1788197590.612483:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11625:x1875060755358976:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 7905us (10187us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788197590.612490:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 212 00000100:00100000:1.0:1788197590.617311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.617385:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755359488 00000100:00100000:2.0:1788197590.617395:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755359488 00000100:00100000:2.0:1788197590.617457:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:2.0:1788197590.617468:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11625:x1875060755359488:12345-192.168.206.40@tcp:103:lfs.0 00010000:00010000:2.0:1788197590.617485:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197590.617510:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030deb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a64 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.617530:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.617534:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197590.617595:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11625:x1875060755359488:12345-192.168.206.40@tcp:103:lfs.0 Request processed in 127us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.617602:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:1.0:1788197590.628049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.628192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755359616 00000100:00100000:0.0:1788197590.628203:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755359616 00000100:00100000:0.0:1788197590.628271:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:0.0:1788197590.628282:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11625:x1875060755359616:12345-192.168.206.40@tcp:58:lfs.0 00010000:00010000:0.0:1788197590.628404:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.628422:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197590.628447:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788197590.628649:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788197590.629141:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11625:x1875060755359616:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 859us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197590.629152:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 213 00000100:00100000:1.0:1788197590.631669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:1.0:1788197590.640189:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197590.645657:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755359744 00000100:00100000:3.0:1788197590.645673:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755359744 00000100:00100000:2.0:1788197590.646045:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 214 00000100:00100000:2.0:1788197590.646057:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+59:11625:x1875060755359744:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197590.646078:0:5871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197590.646104:0:5871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a95 expref: -99 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.646169:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.646182:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 60 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.646204:0:5871:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.646218:0:5871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 60 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.646232:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.646236:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197590.646239:0:5871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 60 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.646246:0:5871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c400, rc 0) 00000100:00100000:2.0:1788197590.646321:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11625:x1875060755359744:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 265us (14662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.646328:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 214 00000004:00080000:3.0:1788197590.894061:0:7124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387040235013ns, next at 388040232453ns, rc = 0 00000100:00100000:0.0:1788197590.894291:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776319616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197590.894385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197590.894530:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776319616 00000100:00100000:3.0:1788197590.894539:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776319616 00000100:00100000:3.0:1788197590.894611:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788197590.894622:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776319616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197590.894658:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197590.894702:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875060776319616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197590.894708:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788197590.894978:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c6066ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776319616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788197590.895057:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788197590.958179:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788197590.958204:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788197590.958248:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788197590.958254:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788197590.958375:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736d25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776319744:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788197590.958497:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788197590.961564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197590.961643:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755359872 00000100:00100000:0.0:1788197590.961651:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755359872 00000100:00100000:2.0:1788197590.961688:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736d25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776319744:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788197590.961783:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:0.0:1788197590.961795:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11626:x1875060755359872:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788197590.961850:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788197590.961944:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11626:x1875060755359872:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 150us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197590.961951:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 215 00000100:00100000:1.0:1788197590.972642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197590.974256:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755360000 00000100:00100000:2.0:1788197590.974270:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755360000 00000100:00100000:2.0:1788197590.974344:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:2.0:1788197590.974354:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11626:x1875060755360000:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788197590.975301:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975319:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975334:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975350:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975431:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975439:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975465:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975492:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975500:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197590.975538:0:5871:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788197590.975542:0:5871:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197590.975553:0:5871:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975562:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975568:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975585:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975590:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197590.975594:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975600:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975611:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:2.0:1788197590.975614:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197590.975618:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975634:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030ea8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975650:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975656:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975661:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975666:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197590.975669:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975674:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975682:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93c7028a4900) 00010000:00010000:2.0:1788197590.975684:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197590.975687:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975692:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030eaf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975708:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975713:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975726:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975730:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197590.975733:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975738:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975745:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197590.975747:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197590.975750:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197590.975755:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197590.979305:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11626:x1875060755360000:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 4933us (6653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197590.979325:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 216 00000100:00100000:1.0:1788197591.001898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.004524:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755360256 00000100:00100000:0.0:1788197591.004540:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755360256 00000100:00100000:0.0:1788197591.004639:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:0.0:1788197591.004653:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+60:11626:x1875060755360256:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197591.004675:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197591.004697:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030ebd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5a9c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.004859:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.004875:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.004886:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197591.004897:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788197591.005008:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005016:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005021:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005027:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197591.005045:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005053:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005066:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:0.0:1788197591.005069:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788197591.005074:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005090:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005134:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030ebd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a9c expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005145:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:0.0:1788197591.005147:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788197591.005151:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030ebd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a9c expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.005159:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:0.0:1788197591.005217:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11626:x1875060755360256:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 568us (3330us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788197591.005224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 217 00000100:00100000:0.0:1788197591.013628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197591.013711:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755360384 00000100:00100000:1.0:1788197591.013720:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755360384 00000100:00100000:1.0:1788197591.013780:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:1.0:1788197591.013791:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11626:x1875060755360384:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788197591.013854:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788197591.013959:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11626:x1875060755360384:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197591.013968:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 218 00000100:00100000:1.0:1788197591.033634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.043905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755360640 00000100:00100000:2.0:1788197591.043924:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755360640 00000100:00100000:2.0:1788197591.043997:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:2.0:1788197591.044008:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11626:x1875060755360640:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197591.044030:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197591.044048:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788197591.044082:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a80 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.044128:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:2.0:1788197591.044133:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197591.044151:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030ed2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5aa3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788197591.045020:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788197591.045237:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.045252:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.045263:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.045512:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d200/0x167e6c2924030ed2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aa3 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.045533:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aa3 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.045542:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:2.0:1788197591.045545:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197591.045548:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197591.045641:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11626:x1875060755360640:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1634us (12017us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788197591.048449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 219 00000100:00100000:3.0:1788197591.053999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197591.054201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755360896 00000100:00100000:1.0:1788197591.054212:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755360896 00000100:00100000:1.0:1788197591.054276:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:1.0:1788197591.054286:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11626:x1875060755360896:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788197591.054347:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197591.054385:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aa3 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054407:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c7028a4900) 00010000:00010000:1.0:1788197591.054419:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197591.054439:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054452:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054461:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054494:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054501:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054507:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054564:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054571:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054589:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054595:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197591.054599:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054606:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054614:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197591.054617:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197591.054620:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054626:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe000/0x167e6c2924030ee7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054644:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054650:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054655:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054659:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197591.054663:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054670:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054678:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc24ae8f4 (ffff93c704a46c00) 00010000:00010000:1.0:1788197591.054680:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197591.054684:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.054689:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf000/0x167e6c2924030eee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc24ae8f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.054774:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11626:x1875060755360896:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 481us (779us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788197591.054789:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 220 00000100:00100000:1.0:1788197591.057262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.057409:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755361024 00000100:00100000:0.0:1788197591.057421:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755361024 00000100:00100000:0.0:1788197591.057497:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 221 00000100:00100000:0.0:1788197591.057510:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+61:11626:x1875060755361024:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197591.057533:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197591.057559:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ef5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5aaa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.057613:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.057646:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.057667:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.057792:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924030ef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.057808:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.057817:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:0.0:1788197591.057819:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788197591.057850:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:0.0:1788197591.057919:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11626:x1875060755361024:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 413us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197591.057927:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 221 00000100:00100000:0.0:1788197591.064363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197591.066425:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755361280 00000100:00100000:1.0:1788197591.066439:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755361280 00000100:00100000:1.0:1788197591.066585:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 222 00000100:00100000:1.0:1788197591.066597:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+62:11626:x1875060755361280:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788197591.066697:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.066713:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.066724:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788197591.067283:0:5871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:1.0:1788197591.067460:0:5871:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009afea0d2 reply state 00000000b7bf6b6b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.067472:0:5871:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788197591.067676:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+64:11626:x1875060755361280:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 1078us (3330us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788197591.067685:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 222 00000100:00100000:1.0:1788197591.072568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.073325:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755361408 00000100:00100000:2.0:1788197591.073338:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755361408 00000100:00100000:2.0:1788197591.073420:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 223 00000100:00100000:2.0:1788197591.073431:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+64:11626:x1875060755361408:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197591.073458:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197591.073478:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5ab1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.073547:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 65 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.073561:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 65 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.073593:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:2.0:1788197591.073596:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197591.073601:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155da00, rc 0) 00000100:00100000:2.0:1788197591.073674:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+65:11626:x1875060755361408:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 244us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197591.073682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 223 00000100:00100000:2.0:1788197591.076673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:0.0:1788197591.077035:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.077049:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.077057:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.077063:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abee00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197591.077084:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.077093:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.077114:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:0.0:1788197591.077117:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788197591.077122:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.077129:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c2924030f03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.077346:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755361536 00000100:00100000:1.0:1788197591.077417:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755361536 00000100:00100000:1.0:1788197591.077545:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:1.0:1788197591.077556:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755361536:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788197591.077926:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2359:x1875060755361536:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 370us (1273us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788197591.077934:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00080000:3.0:1788197591.080740:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788197591.081857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.081999:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755361792 00000100:00100000:2.0:1788197591.082010:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755361792 00000100:00100000:2.0:1788197591.082067:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:2.0:1788197591.082078:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+64:11626:x1875060755361792:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788197591.082348:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+65:11626:x1875060755361792:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 271us (524us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788197591.082375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 60 00000100:00100000:2.0:1788197591.084904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.085003:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755362048 00000100:00100000:0.0:1788197591.085012:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755362048 00000100:00100000:0.0:1788197591.085061:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00100000:0.0:1788197591.085071:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+65:11626:x1875060755362048:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788197591.085184:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+65:11626:x1875060755362048:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 114us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197591.085192:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 224 00000100:00100000:1.0:1788197591.088191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.088287:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755362176 00000100:00100000:2.0:1788197591.088295:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755362176 00000100:00100000:2.0:1788197591.088354:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 225 00000100:00100000:2.0:1788197591.088372:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+65:11626:x1875060755362176:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197591.088392:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197591.088412:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5ab8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.088484:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.088499:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.088510:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197591.088552:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197591.088583:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.088608:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab8 expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.088629:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab8 expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.088667:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:2.0:1788197591.088671:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788197591.088676:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155cc00, rc 0) 00000100:00100000:2.0:1788197591.088751:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+66:11626:x1875060755362176:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 380us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197591.088758:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 225 00000100:00100000:2.0:1788197591.093155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197591.093242:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755362304 00000100:00100000:3.0:1788197591.093252:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755362304 00000100:00100000:3.0:1788197591.093314:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:3.0:1788197591.093326:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+10:2359:x1875060755362304:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788197591.093344:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197591.093406:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5abf expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197591.093443:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95bad6, blocks: 0x1 00010000:00010000:3.0:1788197591.093468:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1788197591.093474:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197591.093486:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.093510:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.093525:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6a00, rc 0) 00000100:00100000:3.0:1788197591.093600:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:2359:x1875060755362304:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 276us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197591.093608:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:1.0:1788197591.097651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.097801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755362560 00000100:00100000:0.0:1788197591.097811:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755362560 00000100:00100000:0.0:1788197591.097907:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 226 00000100:00100000:0.0:1788197591.097918:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+66:11626:x1875060755362560:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788197591.098036:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+66:11626:x1875060755362560:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 118us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197591.098044:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 226 00000100:00100000:1.0:1788197591.100945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.101027:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755362688 00000100:00100000:0.0:1788197591.101038:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755362688 00000100:00100000:0.0:1788197591.101094:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:0.0:1788197591.101103:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:11626:x1875060755362688:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197591.101120:0:8021:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197591.101141:0:8021:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5ac6 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.101171:0:8021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.101180:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197591.101184:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197591.101190:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 12 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.101224:0:8021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.101238:0:8021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 12 pid: 6698 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197591.101251:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776319872:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197591.101351:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433180 going to sleep for 11 seconds 00000100:00100000:2.0:1788197591.104246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197591.104342:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c70480d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8021:1875060776319872:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197591.104386:0:8021:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 12 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.104405:0:8021:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030a00, rc 0) 00000100:00100000:3.0:1788197591.104461:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:11626:x1875060755362688:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 3358us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197591.104470:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:1.0:1788197591.104556:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755362816 00000100:00100000:1.0:1788197591.104564:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755362816 00010000:00010000:1.0:1788197591.104604:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 12 pid: 6698 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.104639:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:1.0:1788197591.104647:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+12:2359:x1875060755362816:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197591.104669:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197591.104692:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 12 pid: 6698 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.104706:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 12 pid: 6698 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.104728:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb227fa/0x167e6c2924030f1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5abf expref: 12 pid: 6698 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.104741:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197591.104746:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197591.104754:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 11 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.104765:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 11 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.104857:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 11 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.104872:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb82d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875060776320000:192.168.206.40@tcp:105: 00000100:00100000:1.0:1788197591.104926:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788197591.114351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197591.114501:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb82d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1875060776320000:192.168.206.40@tcp:105: 00010000:00010000:1.0:1788197591.114527:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197591.114600:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:2359:x1875060755362816:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 9952us (10361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197591.114613:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:3.0:1788197591.114900:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755362944 00000100:00100000:3.0:1788197591.114908:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755362944 00002000:00100000:3.0:1788197591.114972:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93c736d26680 x1875060755362944/t0(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:487/0 lens 504/0 e 0 to 0 dl 1788197602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197591.114983:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736d26680 with x1875060755362944 ext(0->12) 00002000:00010000:3.0:1788197591.114987:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c736d26680 00000100:00100000:3.0:1788197591.115017:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:3.0:1788197591.115026:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+11:2360:x1875060755362944:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788197591.115432:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2360:x1875060755362944:12345-192.168.206.40@tcp:4:lhsmtool_posix.0 Request processed in 406us (1093us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788197591.115440:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00002000:00100000:3.0:1788197591.115450:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93c736d26680 x1875060755362944/t4294967320(0) o4->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:487/0 lens 504/448 e 0 to 0 dl 1788197602 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788197591.115458:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c736d26680 with x1875060755362944 ext(0->12) 00002000:00010000:3.0:1788197591.115461:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c736d26680 00000100:00100000:2.0:1788197591.120334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.120491:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755363072 00000100:00100000:0.0:1788197591.120503:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755363072 00000100:00100000:0.0:1788197591.120594:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 227 00000100:00100000:0.0:1788197591.120605:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+66:11626:x1875060755363072:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788197591.175666:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:3.0:1788197591.175695:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1788197591.175718:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:3.0:1788197591.175745:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c736d4cf00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788197591.175749:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c736ad9a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c736d4ccc0 00000020:00080000:3.0:1788197591.175752:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c736ad9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c736a91c00 00000001:00080000:3.0:1788197591.175766:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1788197591.175800:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1788197591.175805:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:1.0:1788197591.176002:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776320128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788197591.176056:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197591.176137:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776320128 00000100:00100000:1.0:1788197591.176144:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776320128 00000100:00100000:1.0:1788197591.176181:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788197591.176188:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3314:x1875060776320128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788197591.176211:0:12087:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788197591.176235:0:12087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.176256:0:12087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 12 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.176265:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788197591.176280:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197591.176286:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.176308:0:12087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 12 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.176321:0:12087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 12 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.176333:0:12087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12087:1875060776320256:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197591.176403:0:12087:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c0c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788197591.176678:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788197591.176695:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c736add180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788197591.176699:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c736d44d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c736add540 00000020:00080000:3.0:1788197591.176709:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c736d44a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c736d0a000 00000100:00100000:0.0:1788197591.177029:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736d25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11626:x1875060755363072:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 56424us (56706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197591.177038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 227 00000100:00100000:2.0:1788197591.181808:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197591.182058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197591.182082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.182194:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776320384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788197591.182243:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197591.182290:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755363200 00000100:00100000:2.0:1788197591.182297:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755363200 00000100:00100000:2.0:1788197591.182332:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776320384 00000100:00100000:2.0:1788197591.182335:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776320384 00000100:00100000:2.0:1788197591.182360:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:2.0:1788197591.182369:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+13:2360:x1875060755363200:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788197591.182430:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755363328 00000100:00100000:2.0:1788197591.182433:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755363328 00010000:00010000:2.0:1788197591.182453:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 14 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.182480:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:2.0:1788197591.182487:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2359:x1875060755363328:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197591.182511:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197591.182518:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 14 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.182532:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 14 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.182555:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197591.182560:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197591.182566:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.182588:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.182609:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197591.183646:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+14:2359:x1875060755363328:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1150us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197591.183657:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:2.0:1788197591.183715:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788197591.183727:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776320384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788197591.183756:0:8021:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788197591.183801:0:8021:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a95bad5, atime: 0x6a95bad5, ctime: 0x6a95bad5, blocks: 0x1 00010000:00010000:2.0:1788197591.183816:0:8021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.183864:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788197591.183868:0:8021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197591.183873:0:8021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.183902:0:8021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.183912:0:8021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.183920:0:8021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.183939:0:8021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788197591.184745:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1875060776320384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1018us (2497us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788197591.184752:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1788197591.184782:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197591.184788:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.184797:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197591.184802:0:8526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.184865:0:8526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.185181:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.185190:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000594a615/0x167e6c2924030f34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.185213:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197591.185215:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197591.185217:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788197591.185262:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c737007800/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788197591.185269:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776320384:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788197591.189010:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788197591.189263:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1788197591.189901:0:12087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091035077/0x167e6c2924030cef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a25 expref: 13 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.189930:0:12087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12087:1875060776320256:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197591.189961:0:12087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.189972:0:12087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.189978:0:12087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.189989:0:12087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.190012:0:12087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.190037:0:12087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788197591.191302:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1875060776320128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15109us (15240us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788197591.191315:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1788197591.191470:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197591.191479:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.191491:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197591.191496:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.191507:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.191537:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.191545:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebaf584a/0x167e6c2924030f2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.191567:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197591.191568:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197591.191570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788197591.192094:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c73bb82d80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788197591.192110:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776320128:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788197591.242668:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1788197591.242699:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1788197591.242705:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1788197591.242716:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1788197591.243049:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755363200:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 60673us (60989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197591.243060:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:0.0:1788197591.246585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.246889:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755363584 00000100:00100000:2.0:1788197591.246900:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755363584 00000100:00100000:2.0:1788197591.247009:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 228 00000100:00100000:2.0:1788197591.247021:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11626:x1875060755363584:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788197591.247076:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197591.247102:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.247120:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:2.0:1788197591.247125:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197591.247153:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.247179:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.247189:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197591.247463:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023a214f9 reply state 00000000aedeecad transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.247472:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197591.247581:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:11626:x1875060755363584:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 552us (1006us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788197591.247589:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 228 00000100:00100000:2.0:1788197591.251565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:0.0:1788197591.252053:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.252066:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.252073:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.252079:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197591.252084:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.252091:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.252111:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:0.0:1788197591.252114:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197591.252118:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.252142:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030f3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197591.252318:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755363712 00000100:00100000:3.0:1788197591.252328:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755363712 00000100:00100000:3.0:1788197591.252496:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:3.0:1788197591.252508:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2357:x1875060755363712:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788197591.252775:0:8021:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788197591.252989:0:8021:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788197590 00002000:00010000:3.0:1788197591.252992:0:8021:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788197589 00002000:00010000:3.0:1788197591.252994:0:8021:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788197590 -> 1788197590 00002000:00010000:3.0:1788197591.252996:0:8021:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788197591.253054:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2357:x1875060755363712:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 548us (1503us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788197591.253062:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:0.0:1788197591.258436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197591.258528:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755363968 00000100:00100000:3.0:1788197591.258537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755363968 00000100:00100000:3.0:1788197591.258628:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 229 00000100:00100000:3.0:1788197591.258639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11626:x1875060755363968:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788197591.258774:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.258904:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.258914:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.258950:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.258964:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 20 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197591.258979:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776320512:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197591.259073:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056ecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788197591.264647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197591.265513:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755364096 00000100:00100000:1.0:1788197591.265523:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755364096 00010000:00010000:1.0:1788197591.265565:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.265610:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:1.0:1788197591.265621:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:2360:x1875060755364096:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197591.265634:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197591.265641:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.265654:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.265688:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:1.0:1788197591.265693:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.265702:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.265723:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.265743:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197591.265806:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:2360:x1875060755364096:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 186us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197591.265813:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00010000:00010000:3.0:1788197591.271077:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030efc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5aaa expref: 20 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197591.271103:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1875060776320512:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197591.271125:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271134:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271140:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271170:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271195:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271201:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271207:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197591.271212:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271219:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271238:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:3.0:1788197591.271241:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788197591.271245:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.271250:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030f42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197591.271320:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11626:x1875060755363968:12345-192.168.206.40@tcp:55:lhsmtool_posix.0 Request processed in 12682us (12893us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788197591.271330:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 229 00000100:00100000:0.0:1788197591.275027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197591.275114:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755364224 00000100:00100000:1.0:1788197591.275125:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755364224 00000100:00100000:1.0:1788197591.275282:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:1.0:1788197591.275295:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2360:x1875060755364224:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788197591.275341:0:12087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.275376:0:12087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.275385:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197591.275390:0:12087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788197591.275395:0:12087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.275433:0:12087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 8 pid: 8021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.275450:0:12087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 8 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.275482:0:12087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12087:1875060776320640:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197591.275560:0:12087:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788197591.280752:0:12087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12087:1875060776320640:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197591.281085:0:12087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197591.281713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.282153:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755364352 00000100:00100000:2.0:1788197591.282173:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755364352 00010000:00010000:2.0:1788197591.282210:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 9 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.282246:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:2.0:1788197591.282256:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+9:2359:x1875060755364352:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197591.282272:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197591.282293:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 9 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.282307:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 9 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.282331:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a34f275/0x167e6c2924030f26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ac6 expref: 9 pid: 8021 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.282348:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197591.282380:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788197591.282386:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.282396:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.282466:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197591.282527:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755364352:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 272us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197591.282535:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 82 00010000:00010000:1.0:1788197591.283120:0:12087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283132:0:12087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283262:0:12087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283273:0:12087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283280:0:12087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283288:0:12087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197591.283292:0:12087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283301:0:12087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283329:0:12087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.283337:0:12087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7481d6e/0x167e6c2924030f49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.283461:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755364224:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 8167us (8679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197591.283472:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:3.0:1788197591.287744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.288165:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755364608 00000100:00100000:0.0:1788197591.288176:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755364608 00000100:00100000:0.0:1788197591.288267:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 230 00000100:00100000:0.0:1788197591.288278:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11626:x1875060755364608:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788197591.288351:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.288430:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.288442:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.288638:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.288650:0:5871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.288658:0:5871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.289253:0:5871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.289270:0:5871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 20 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.289284:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb82300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776320768:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197591.289474:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73bbab780 going to sleep for 11 seconds 00000100:00100000:2.0:1788197591.293305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.293406:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755364736 00000100:00100000:0.0:1788197591.293416:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755364736 00010000:00010000:0.0:1788197591.293459:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197591.293498:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:0.0:1788197591.293508:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:2360:x1875060755364736:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197591.293523:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197591.293530:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.293543:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.293565:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:0.0:1788197591.293570:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.293589:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.293595:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197591.293611:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197591.293966:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155da00/0x167e6c2924030f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ab1 expref: 21 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197591.293985:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb82300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776320768:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197591.294004:0:5871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.294013:0:5871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197591.294019:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788197591.294206:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788197591.294380:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788197591.294426:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788197591.294509:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875060776320896:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788197591.294567:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197591.294612:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7368e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197591.294906:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776320896 00000100:00100000:2.0:1788197591.294912:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776320896 00000100:00100000:2.0:1788197591.294953:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788197591.294961:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875060776320896:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788197591.295038:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875060776320896:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197591.295046:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788197591.295081:0:5871:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788197591.295087:0:5871:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788197591.295105:0:5871:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c73bb82d80, transno 4294967321 00000100:00100000:0.0:1788197591.295380:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:2360:x1875060755364736:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1870us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197591.295391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:2.0:1788197591.297266:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875060776320896:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788197591.298459:0:5871:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788197591.298542:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875060776321024:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788197591.298613:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197591.298647:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433240 going to sleep for 11 seconds 00000100:00100000:1.0:1788197591.298765:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776321024 00000100:00100000:1.0:1788197591.298773:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776321024 00000100:00100000:1.0:1788197591.299043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788197591.299055:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5871:x1875060776321024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788197591.299253:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5871:x1875060776321024:12345-0@lo:1000:mdt00_003.0 Request processed in 199us (638us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788197591.299261:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197591.299334:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737004380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5871:1875060776321024:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788197591.299383:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299393:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299400:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299406:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197591.299410:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299417:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299432:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c719ede800) 00010000:00010000:2.0:1788197591.299434:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197591.299439:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299446:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924030f57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299479:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299486:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299491:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299503:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197591.299507:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299513:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299521:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197591.299524:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197591.299530:0:5871:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299541:0:5871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299549:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.299586:0:5871:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 23 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.299598:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776321152:192.168.206.40@tcp:105: 00000100:00100000:2.0:1788197591.299723:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433240 going to sleep for 11 seconds 00000100:00100000:1.0:1788197591.305272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197591.305374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755364864 00000100:00100000:3.0:1788197591.305385:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755364864 00000100:00100000:3.0:1788197591.305440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:3.0:1788197591.305451:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11625:x1875060755364864:12345-192.168.206.40@tcp:49:lfs.0 00000100:00100000:3.0:1788197591.305586:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11625:x1875060755364864:12345-192.168.206.40@tcp:49:lfs.0 Request processed in 136us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197591.305594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 61 00000100:00100000:3.0:1788197591.308125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197591.308262:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755365120 00000100:00100000:0.0:1788197591.308272:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755365120 00000100:00100000:0.0:1788197591.308326:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 231 00000100:00100000:0.0:1788197591.308336:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11625:x1875060755365120:12345-192.168.206.40@tcp:58:lfs.0 00000100:00100000:2.0:1788197591.309049:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5871:1875060776321152:192.168.206.40@tcp:105: 00010000:00010000:2.0:1788197591.309080:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309106:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030c00/0x167e6c2924030e9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309144:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309157:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309169:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309179:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309185:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309191:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309197:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197591.309201:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309208:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309221:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197591.309224:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197591.309228:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309242:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309255:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309261:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309267:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309272:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197591.309275:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309281:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309289:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197591.309292:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788197591.309294:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.309299:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924030f50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788197591.309738:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788197591.310034:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11625:x1875060755365120:12345-192.168.206.40@tcp:58:lfs.0 Request processed in 1694us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197591.310046:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 231 00000100:00100000:2.0:1788197591.310126:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:11626:x1875060755364608:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 21850us (22392us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788197591.310134:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 230 00000020:00080000:2.0:1788197591.310144:0:5871:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788197591.314210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000040:00080000:2.0:1788197591.314515:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788197591.314520:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788197591.314551:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788197591.314557:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788197591.314860:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776321280:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788197591.315001:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788197591.316059:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755365376 00000100:00100000:3.0:1788197591.316086:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755365376 00000100:00100000:3.0:1788197591.316154:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 62 00000100:00100000:3.0:1788197591.316167:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706340450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+24:11626:x1875060755365376:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788197591.323011:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788197591.323120:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788197591.323195:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.323212:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.323224:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.323232:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.323238:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.323244:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.323258:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788197591.323500:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706340450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+26:11626:x1875060755365376:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 7331us (9296us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788197591.323510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 62 00000020:00080000:2.0:1788197591.323522:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788197591.323999:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1875060776321280:192.168.206.40@tcp:107:hsm_cdtr.0 00010000:00010000:1.0:1788197591.324202:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197591.324210:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.324218:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197591.324222:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.324230:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.324244:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93c7028a4b00) 00010000:00010000:1.0:1788197591.324247:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788197591.324251:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.324258:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d400/0x167e6c2924030f65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.324277:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197591.324279:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197591.324281:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197591.332020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.332209:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755365504 00000100:00100000:2.0:1788197591.332222:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755365504 00000100:00100000:2.0:1788197591.332286:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 232 00000100:00100000:2.0:1788197591.332301:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:11628:x1875060755365504:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788197591.332345:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788197591.332471:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:11628:x1875060755365504:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 173us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197591.332479:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 232 00000100:00100000:0.0:1788197591.339966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197591.340074:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755365760 00000100:00100000:1.0:1788197591.340084:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755365760 00000100:00100000:1.0:1788197591.340150:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:1.0:1788197591.340170:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+25:11628:x1875060755365760:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197591.340194:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197591.340227:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030f6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5acd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.340325:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.340340:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.340351:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197591.340373:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788197591.340509:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030f6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5acd expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.340528:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5acd expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.340537:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:1.0:1788197591.340540:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788197591.340543:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf200, rc 0) 00000100:00100000:1.0:1788197591.340612:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:11628:x1875060755365760:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 444us (658us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788197591.340619:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 233 00000100:00100000:0.0:1788197591.351106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.351418:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755366016 00000100:00100000:2.0:1788197591.351428:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755366016 00000100:00100000:2.0:1788197591.351483:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 234 00000100:00100000:2.0:1788197591.351494:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+27:11628:x1875060755366016:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788197591.351584:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.351602:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.351615:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197591.351661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:2.0:1788197591.351864:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.351872:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.352138:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.352145:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197591.352149:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.352157:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.352170:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197591.352173:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788197591.352178:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.352184:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155d800/0x167e6c2924030f81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.352694:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7012ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:11628:x1875060755366016:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 1197us (1875us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788197591.352703:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 234 00000100:00100000:2.0:1788197591.352726:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755366144 00000100:00100000:2.0:1788197591.352731:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755366144 00000040:00080000:3.0:1788197591.352923:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197591.352928:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788197591.353143:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 235 00000100:00100000:1.0:1788197591.353157:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+28:11630:x1875060755366144:12345-192.168.206.40@tcp:101:lfs.0 00000040:00080000:3.0:1788197591.353660:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788197591.354082:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788197591.355147:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197591.355177:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030f88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5ad4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.355992:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356008:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356019:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356044:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356050:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356056:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356307:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356328:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.356339:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197591.356346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:1.0:1788197591.356385:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.356497:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755366400 00000100:00100000:2.0:1788197591.356506:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755366400 00010000:00010000:1.0:1788197591.356548:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 30 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197591.356570:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb83800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776321408:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197591.356610:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:2.0:1788197591.356623:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:11628:x1875060755366400:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788197591.356814:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:11628:x1875060755366400:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 193us (472us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788197591.356866:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 63 00000100:00100000:1.0:1788197591.356949:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736d4c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788197591.359956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.360033:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755366656 00000100:00100000:2.0:1788197591.360043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755366656 00000100:00100000:2.0:1788197591.360083:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:2.0:1788197591.360092:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:5598:x1875060755366656:12345-192.168.206.40@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788197591.360271:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb83800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1875060776321408:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197591.360298:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.361154:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:5598:x1875060755366656:12345-192.168.206.40@tcp:35:ldlm_bl.0 Request processed in 1058us (1204us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788197591.361165:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 64 00000100:00100000:0.0:1788197591.363138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197591.363290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755366784 00000100:00100000:2.0:1788197591.363299:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755366784 00010000:00010000:2.0:1788197591.363413:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 32 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197591.363453:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:2.0:1788197591.363463:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:2360:x1875060755366784:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197591.363477:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197591.363485:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 32 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.363499:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 32 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.363525:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924030e8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a8e expref: 32 pid: 5841 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.363541:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197591.363561:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.364000:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.364012:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197591.364045:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197591.364100:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+31:2360:x1875060755366784:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 638us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197591.364109:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00010000:00010000:1.0:1788197591.364223:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364232:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197591.364501:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788197591.364506:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197591.364527:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364540:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364548:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364555:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364588:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364594:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197591.364598:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364606:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364617:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:1.0:1788197591.364620:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197591.364623:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364630:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf400/0x167e6c2924030f8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364641:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364647:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364652:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364656:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197591.364659:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364674:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364683:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93c704a46d00) 00010000:00010000:1.0:1788197591.364685:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197591.364688:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364693:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe600/0x167e6c2924030f96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364728:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe800/0x167e6c2924030f88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ad4 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364741:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ad4 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197591.364748:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:1.0:1788197591.364750:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197591.364752:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfe00, rc 0) 00000100:00100000:1.0:1788197591.364796:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:11630:x1875060755366144:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 11643us (13135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197591.364804:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 235 00010000:00010000:2.0:1788197591.662166:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788197592.260799:0:12579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788197592.260809:0:12579:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788197592.260875:0:12579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788197592.260882:0:12579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788197592.477675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197592.480677:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367040 00000100:00100000:3.0:1788197592.480920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367040 00000100:00100000:3.0:1788197592.480995:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:3.0:1788197592.481005:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+30:11653:x1875060755367040:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197592.481027:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197592.481045:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030fa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5adb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197592.481129:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030fab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197592.481142:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030fab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197592.481154:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030fab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197592.481165:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788197592.481327:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6e00/0x167e6c2924030fa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5adb expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197592.481363:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5adb expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197592.481371:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:3.0:1788197592.481374:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788197592.481377:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6a00, rc 0) 00000100:00080000:1.0:1788197592.481482:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197592.482351:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11653:x1875060755367040:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1340us (4679us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788197592.482362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 236 00000100:00100000:2.0:1788197592.504590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197592.504688:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367168 00000100:00100000:0.0:1788197592.504933:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367168 00000100:00100000:2.0:1788197592.505118:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 237 00000100:00100000:2.0:1788197592.505130:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11653:x1875060755367168:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:2.0:1788197592.505215:0:5871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505232:0:5871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505243:0:5871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505269:0:5871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505276:0:5871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505317:0:5871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505324:0:5871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155dc00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197592.505328:0:5871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505336:0:5871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505350:0:5871:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:2.0:1788197592.505353:0:5871:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197592.505359:0:5871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197592.505366:0:5871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155dc00/0x167e6c2924030fb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5871 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197592.505748:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:11653:x1875060755367168:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 618us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197592.505757:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 237 00000100:00100000:0.0:1788197592.622997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197592.623088:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367296 00000100:00100000:3.0:1788197592.623099:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367296 00000100:00100000:3.0:1788197592.623166:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:3.0:1788197592.623178:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2359:x1875060755367296:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:3.0:1788197592.623196:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197592.623217:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030fc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5ae2 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788197592.623247:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a95bad6, atime: 0x6a95bad5, ctime: 0x6a95bad6, blocks: 0xb 00010000:00010000:3.0:1788197592.623268:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1788197592.623273:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197592.623283:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ae2 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197592.623302:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ae2 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197592.623340:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6e00, rc 0) 00000100:00100000:3.0:1788197592.623399:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2359:x1875060755367296:12345-192.168.206.40@tcp:101:cat.0 Request processed in 223us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197592.623406:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 70 00000100:00100000:0.0:1788197592.628938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197592.629889:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367424 00000100:00100000:1.0:1788197592.629901:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367424 00002000:00100000:1.0:1788197592.629955:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93c741050a80 x1875060755367424/t0(0) o3->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:488/0 lens 488/0 e 0 to 0 dl 1788197603 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788197592.629966:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741050a80 with x1875060755367424 ext(0->4095) 00002000:00010000:1.0:1788197592.629972:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c741050a80 00000100:00100000:1.0:1788197592.630010:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:1.0:1788197592.630021:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2358:x1875060755367424:12345-192.168.206.40@tcp:3:cat.0 00000100:00100000:1.0:1788197592.630233:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+8:2358:x1875060755367424:12345-192.168.206.40@tcp:3:cat.0 Request processed in 212us (1309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788197592.630240:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00002000:00100000:1.0:1788197592.630247:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93c741050a80 x1875060755367424/t0(0) o3->87c79f47-cb13-4c8a-942c-8f23eb455b39@192.168.206.40@tcp:488/0 lens 488/4536 e 0 to 0 dl 1788197603 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788197592.630256:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93c741050a80 with x1875060755367424 ext(0->4095) 00002000:00010000:1.0:1788197592.630259:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93c741050a80 00010000:00010000:2.0:1788197592.686063:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788197593.007694:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788197593.007917:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788197593.007926:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788197593.198933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197593.199006:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367552 00000100:00100000:1.0:1788197593.199016:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367552 00000100:00100000:1.0:1788197593.199086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 298 00000100:00100000:1.0:1788197593.199097:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755367552:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197593.199186:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755367552:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197593.199193:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 298 00000100:00100000:0.0:1788197593.206617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197593.207222:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367680 00000100:00100000:2.0:1788197593.207235:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367680 00000100:00100000:3.0:1788197593.207279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197593.207305:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 162 00000100:00100000:2.0:1788197593.207317:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:2360:x1875060755367680:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197593.207375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197593.207387:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+32:2360:x1875060755367680:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 72us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197593.207412:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 162 00000100:00100000:2.0:1788197593.207429:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367936 00000100:00100000:2.0:1788197593.207439:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367936 00000100:00100000:2.0:1788197593.207473:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 163 00000100:00100000:2.0:1788197593.207479:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755367936:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197593.207509:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2359:x1875060755367936:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 28us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197593.207515:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 163 00000100:00080000:2.0:1788197593.207535:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197593.207780:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755367808 00000100:00100000:1.0:1788197593.207786:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755367808 00000100:00100000:1.0:1788197593.207867:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:1.0:1788197593.207875:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755367808:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197593.207913:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755367808:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 39us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197593.207920:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00080000:2.0:1788197593.207948:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788197593.714338:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197594.734991:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197594.992251:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776321536:0@lo:400:kworker.0 00000100:00100000:3.0:1788197594.992275:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776321792:0@lo:400:kworker.0 00000100:00100000:1.0:1788197594.992339:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776321664:0@lo:400:kworker.0 00000100:00100000:0.0:1788197594.992339:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776321920:0@lo:400:kworker.0 00000100:00100000:2.0:1788197594.998499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197594.998599:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776322048:0@lo:400:kworker.0 00000100:00100000:2.0:1788197594.998649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197594.998707:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776321536 00000100:00100000:2.0:1788197594.998716:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776321536 00000100:00100000:2.0:1788197594.998774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788197594.998783:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776321536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197594.998856:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3312:x1875060776321536:12345-0@lo:400:kworker.0 Request processed in 74us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197594.998863:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788197594.999016:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322048 00000100:00100000:2.0:1788197594.999021:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322048 00000100:00100000:2.0:1788197594.999055:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788197594.999061:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776322048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197594.999107:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c6066dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776322048:12345-0@lo:400:kworker.0 Request processed in 46us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197594.999113:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788197594.999130:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197594.999160:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776322048:0@lo:400:kworker.0 00000100:00100000:2.0:1788197594.999170:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7414cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3312:1875060776321536:0@lo:400:kworker.0 00000100:00100000:3.0:1788197595.007079:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197595.007624:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776321792 00000100:00100000:2.0:1788197595.007636:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776321792 00000100:00100000:2.0:1788197595.007729:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788197595.007741:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776321792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197595.007819:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776321792:12345-0@lo:400:kworker.0 Request processed in 81us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197595.007847:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788197595.008009:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197595.008044:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776321792:0@lo:400:kworker.0 00000100:00100000:0.0:1788197595.009901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197595.010196:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776321920 00000100:00100000:3.0:1788197595.010206:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776321920 00000100:00100000:3.0:1788197595.010280:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788197595.010290:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776321920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197595.010351:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776321920:12345-0@lo:400:kworker.0 Request processed in 63us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197595.010358:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788197595.010422:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197595.011178:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776321920:0@lo:400:kworker.0 00000100:00100000:1.0:1788197595.011729:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197595.011841:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776322176:0@lo:400:kworker.0 00000100:00100000:1.0:1788197595.011893:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197595.011996:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322176 00000100:00100000:3.0:1788197595.012003:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322176 00000100:00100000:3.0:1788197595.012068:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788197595.012078:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776322176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197595.012129:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776322176:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197595.012135:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788197595.012313:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197595.012727:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788197595.012733:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c605583480, transno 4294967307 00000004:00080000:1.0:1788197595.012755:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788197595.012775:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c737007800, transno 4294967310 00000100:00100000:1.0:1788197595.012782:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776322176:0@lo:400:kworker.0 00000100:00100000:2.0:1788197595.015053:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776321664 00000100:00100000:2.0:1788197595.015066:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776321664 00000100:00100000:2.0:1788197595.015128:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788197595.015137:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776321664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197595.015232:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776321664:12345-0@lo:400:kworker.0 Request processed in 96us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197595.015239:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788197595.015443:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776321664:0@lo:400:kworker.0 00000040:00080000:3.0:1788197595.439044:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788197595.439053:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197595.439086:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788197595.439093:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788197595.502153:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776322304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197595.502224:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197595.502473:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322304 00000100:00100000:0.0:1788197595.502482:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322304 00000100:00100000:0.0:1788197595.502532:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788197595.502541:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776322304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197595.502594:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197595.502643:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776322304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197595.502651:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788197595.502783:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776322304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788197595.758063:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197596.014755:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:3.0:1788197596.014798:0:7124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392160973960ns, next at 393160971575ns, rc = 0 00000100:00100000:2.0:1788197596.020307:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776322432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197596.020390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197596.020730:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322432 00000100:00100000:0.0:1788197596.020749:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322432 00000100:00100000:0.0:1788197596.020813:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788197596.020856:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776322432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197596.020892:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197596.020953:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776322432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197596.020960:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788197596.021177:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776322432:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788197596.557186:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1788197596.557203:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1788197596.566804:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000001:00080000:3.0:1788197596.566848:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:3.0:1788197596.566855:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1788197596.566875:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93c709433c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788197596.566881:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c74141eb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93c7094339c0 00000020:00080000:3.0:1788197596.566884:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93c74141e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93c7417d5800 00000020:00080000:3.0:1788197596.566899:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:3.0:1788197596.566905:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:3.0:1788197596.566916:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788197596.566936:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788197596.567120:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788197596.567370:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776322560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788197596.567439:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197596.567467:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322560 00000100:00100000:1.0:1788197596.567477:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322560 00000100:00100000:1.0:1788197596.567526:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788197596.567537:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776322560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788197596.567720:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788197596.567724:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788197590 -> 1788197590 00002000:00010000:1.0:1788197596.567727:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788197589 -> 1788197589 00002000:00010000:1.0:1788197596.567729:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788197590 -> 1788197590 00002000:00010000:1.0:1788197596.567732:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788197596.567879:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776322560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 342us (439us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788197596.567886:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788197596.568094:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788197596.568100:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1788197596.568131:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93c73bb82680 x1875060776322560/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788197612 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788197596.568145:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c73bb82680/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788197596.568151:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776322560:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788197596.783117:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197597.350134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197597.350268:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755368064 00000100:00100000:2.0:1788197597.350279:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755368064 00000100:00100000:2.0:1788197597.350375:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 238 00000100:00100000:2.0:1788197597.350386:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11314:x1875060755368064:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788197597.350485:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11314:x1875060755368064:12345-192.168.206.40@tcp:60:lhsmtool_posix.0 Request processed in 100us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197597.350493:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 238 00000100:00080000:0.0:1788197597.351127:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197597.355526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197597.355645:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755368320 00000100:00100000:2.0:1788197597.355656:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755368320 00000100:00100000:2.0:1788197597.355778:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:2.0:1788197597.355791:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:11314:x1875060755368320:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788197597.356186:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:11314:x1875060755368320:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 397us (672us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788197597.356195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 65 00000100:00100000:1.0:1788197597.494343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197597.494452:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755368448 00000100:00100000:2.0:1788197597.494464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755368448 00000100:00100000:2.0:1788197597.494994:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 239 00000100:00100000:2.0:1788197597.495021:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:12104:x1875060755368448:12345-192.168.206.40@tcp:101:lsof.0 00010000:00010000:2.0:1788197597.495040:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197597.495060:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030fc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5ae9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197597.495116:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030fce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197597.495130:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197597.495142:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788197597.495182:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788197597.495383:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788197597.495388:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197597.495412:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197597.495440:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c200/0x167e6c2924030fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ae9 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197597.495458:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030fce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ae9 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197597.495466:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:2.0:1788197597.495469:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788197597.495473:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155cc00, rc 0) 00000100:00100000:2.0:1788197597.496050:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:12104:x1875060755368448:12345-192.168.206.40@tcp:101:lsof.0 Request processed in 1029us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197597.496071:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 239 00010000:00010000:2.0:1788197597.807811:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197598.321297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197598.321404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755368576 00000100:00100000:0.0:1788197598.321408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197598.321414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755368576 00000100:00100000:0.0:1788197598.321449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197598.321475:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 300 00000100:00100000:0.0:1788197598.321479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197598.321485:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755368576:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197598.321682:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755368832 00000100:00100000:3.0:1788197598.321685:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+13:2360:x1875060755368576:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 199us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197598.321688:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755368832 00000100:00100000:3.0:1788197598.321698:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 300 00000100:00100000:0.0:1788197598.321748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197598.321752:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:1.0:1788197598.321763:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755368832:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197598.321766:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755368960 00000100:00100000:3.0:1788197598.321784:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755368960 00000100:00100000:1.0:1788197598.321802:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2360:x1875060755368832:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 41us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197598.321810:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:2.0:1788197598.321849:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755369088 00000100:00100000:2.0:1788197598.321856:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755369088 00000100:00080000:1.0:1788197598.321881:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788197598.321887:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788197598.321897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755368704 00000100:00100000:2.0:1788197598.321902:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755368704 00000100:00100000:3.0:1788197598.321913:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:3.0:1788197598.321922:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755368960:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197598.321957:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00100000:0.0:1788197598.321966:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2360:x1875060755369088:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197598.322176:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2360:x1875060755368960:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 253us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197598.322184:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:2.0:1788197598.322275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 168 00000100:00100000:2.0:1788197598.322283:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:2360:x1875060755368704:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197598.322468:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2360:x1875060755369088:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 502us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197598.322486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 167 00000100:00100000:2.0:1788197598.324652:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:2360:x1875060755368704:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 2360us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197598.324665:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 168 00010000:00010000:2.0:1788197598.832711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197599.862911:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197600.115778:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776322816:0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.115863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197600.115912:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776323328:0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.115937:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197600.115967:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788197600.115974:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776322688:0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.116002:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197600.116028:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74179aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776323200:0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.116052:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197600.116081:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322816 00000100:00100000:1.0:1788197600.116088:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322816 00000100:00100000:1.0:1788197600.116125:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323200 00000100:00100000:1.0:1788197600.116141:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323200 00000100:00100000:1.0:1788197600.116175:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788197600.116183:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c740ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776322816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.116233:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c740ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776322816:12345-0@lo:400:kworker.0 Request processed in 50us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197600.116241:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788197600.116256:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788197600.116262:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776323200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.116289:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776323200:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197600.116295:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788197600.116312:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323328 00000100:00100000:1.0:1788197600.116316:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323328 00000100:00100000:1.0:1788197600.116340:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788197600.116346:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c709109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776323328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.116374:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c709109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776323328:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197600.116380:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788197600.116394:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788197600.116398:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197600.116426:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74179aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776323200:0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.116436:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776322816:0@lo:400:kworker.0 00000100:00100000:1.0:1788197600.116444:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776323328:0@lo:400:kworker.0 00000100:00100000:0.0:1788197600.116858:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776322944:0@lo:400:kworker.0 00000100:00100000:0.0:1788197600.116892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197600.116916:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197600.116922:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74179bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776323072:0@lo:400:kworker.0 00000100:00100000:0.0:1788197600.116944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197600.116973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322944 00000100:00100000:0.0:1788197600.116978:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322944 00000100:00100000:0.0:1788197600.117011:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788197600.117018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776322944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197600.117053:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776322944:12345-0@lo:400:kworker.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197600.117060:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788197600.117083:0:8021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323072 00000100:00100000:0.0:1788197600.117087:0:8021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323072 00000100:00100000:0.0:1788197600.117111:0:8021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788197600.117117:0:8021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776323072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197600.117146:0:8021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776323072:12345-0@lo:400:kworker.0 Request processed in 30us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197600.117152:0:8021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788197600.117169:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197600.117172:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197600.117189:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74179bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776323072:0@lo:400:kworker.0 00000100:00100000:0.0:1788197600.117198:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776322944:0@lo:400:kworker.0 00000100:00100000:2.0:1788197600.119879:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776322688 00000100:00100000:2.0:1788197600.119892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776322688 00000100:00100000:2.0:1788197600.119984:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788197600.119994:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776322688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197600.120096:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776322688:12345-0@lo:400:kworker.0 Request processed in 104us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197600.120104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788197600.120207:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776322688:0@lo:400:kworker.0 00000100:00100000:3.0:1788197600.631068:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197600.631088:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197600.631147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197600.632481:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323456 00000100:00100000:0.0:1788197600.632516:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323456 00000100:00100000:0.0:1788197600.632577:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788197600.632586:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776323456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197600.632620:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197600.632688:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776323456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197600.632695:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788197600.632907:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776323456:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788197600.839275:0:12781:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:33:19 (1788197599) 00010000:00010000:2.0:1788197600.879934:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197601.134560:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788197601.142472:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776323584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197601.142551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197601.142641:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323584 00000100:00100000:0.0:1788197601.142649:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323584 00000100:00100000:0.0:1788197601.142705:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788197601.142714:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776323584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788197601.142767:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197601.142846:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875060776323584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197601.142854:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788197601.143612:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776323584:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788197601.683232:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788197601.687020:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788197601.687042:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788197601.687122:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788197601.687133:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788197601.902186:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197602.926058:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197603.438541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197603.438596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197603.438631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197603.438665:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197603.438696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197603.438735:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755369600 00000100:00100000:1.0:1788197603.438744:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755369600 00000100:00100000:1.0:1788197603.438806:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755369472 00000100:00100000:1.0:1788197603.438810:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755369472 00000100:00100000:1.0:1788197603.438868:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:1.0:1788197603.438878:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755369600:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197603.438946:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2357:x1875060755369600:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 69us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197603.438954:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:1.0:1788197603.438969:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:1.0:1788197603.438975:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2357:x1875060755369472:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197603.439003:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2357:x1875060755369472:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197603.439010:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 104 00000100:00100000:0.0:1788197603.439284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755369344 00000100:00100000:0.0:1788197603.439289:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755369344 00000100:00100000:0.0:1788197603.439324:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755369728 00000100:00100000:0.0:1788197603.439327:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755369728 00000100:00100000:0.0:1788197603.439356:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:0.0:1788197603.439363:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:2357:x1875060755369344:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197603.439427:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70910bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:2357:x1875060755369344:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 64us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197603.439434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 172 00000100:00100000:0.0:1788197603.439448:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00100000:0.0:1788197603.439454:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2357:x1875060755369728:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197603.439477:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2357:x1875060755369728:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 23us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197603.439482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 173 00000100:00080000:0.0:1788197603.439499:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788197603.439503:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197603.439514:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788197603.439734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755369216 00000100:00100000:2.0:1788197603.439739:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755369216 00000100:00100000:2.0:1788197603.439774:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 302 00000100:00100000:2.0:1788197603.439780:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755369216:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197603.439852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755369216:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 71us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197603.439863:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 302 00010000:00010000:2.0:1788197603.949971:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197604.203141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197604.203237:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755369984 00000100:00100000:2.0:1788197604.203247:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755369984 00000100:00100000:2.0:1788197604.203304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:2.0:1788197604.203314:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+19:12325:x1875060755369984:12345-192.168.206.40@tcp:35:umount.0 00000100:00100000:2.0:1788197604.203679:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:12325:x1875060755369984:12345-192.168.206.40@tcp:35:umount.0 Request processed in 365us (547us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788197604.203687:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 66 00000100:00100000:3.0:1788197604.205673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197604.206280:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755370240 00000100:00100000:2.0:1788197604.206350:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755370240 00000100:00100000:2.0:1788197604.206399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:2.0:1788197604.206409:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+20:12325:x1875060755370240:12345-192.168.206.40@tcp:35:umount.0 00000100:00100000:2.0:1788197604.207899:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:12325:x1875060755370240:12345-192.168.206.40@tcp:35:umount.0 Request processed in 1483us (2227us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788197604.207911:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 67 00000100:00100000:0.0:1788197604.213663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197604.213819:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755370496 00000100:00100000:1.0:1788197604.213857:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755370496 00000100:00100000:1.0:1788197604.213913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:1.0:1788197604.213924:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706342450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+21:12325:x1875060755370496:12345-192.168.206.40@tcp:35:umount.0 00000100:00100000:1.0:1788197604.214160:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706342450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:12325:x1875060755370496:12345-192.168.206.40@tcp:35:umount.0 Request processed in 237us (599us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788197604.214180:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 68 00000100:00100000:1.0:1788197604.218980:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197604.219289:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755370752 00000100:00100000:2.0:1788197604.219299:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755370752 00000100:00100000:2.0:1788197604.219350:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:2.0:1788197604.219365:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+22:12325:x1875060755370752:12345-192.168.206.40@tcp:35:umount.0 00000100:00100000:2.0:1788197604.219724:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:12325:x1875060755370752:12345-192.168.206.40@tcp:35:umount.0 Request processed in 363us (752us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788197604.219732:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 69 00000100:00100000:3.0:1788197604.224944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197604.224985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197604.225011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197604.225203:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755370880 00000100:00100000:1.0:1788197604.225213:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755370880 00000100:00100000:1.0:1788197604.225270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755371136 00000100:00100000:1.0:1788197604.225273:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755371136 00000100:00100000:1.0:1788197604.225296:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755371008 00000100:00100000:1.0:1788197604.225299:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755371008 00000100:00100000:1.0:1788197604.225318:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1788197604.225327:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+15:2357:x1875060755370880:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197604.225342:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197604.225362:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701386c00/0x167e6c2924030046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5674 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197604.225379:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197604.225430:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+14:2357:x1875060755370880:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 103us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197604.225449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:1.0:1788197604.225467:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:1.0:1788197604.225474:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+13:2357:x1875060755371136:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197604.225483:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197604.225493:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700031600/0x167e6c292403025a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d573f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197604.225513:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197604.225531:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+12:2357:x1875060755371136:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 58us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197604.225557:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:1.0:1788197604.225605:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:1.0:1788197604.225612:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+11:2357:x1875060755371008:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197604.225620:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197604.225630:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6c00/0x167e6c292402ffac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d563c expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197604.225640:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197604.225657:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+10:2357:x1875060755371008:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 45us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197604.225663:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:3.0:1788197604.227010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197604.227191:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755371264 00000100:00100000:1.0:1788197604.227198:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755371264 00000100:00100000:1.0:1788197604.227237:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:1.0:1788197604.227246:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2356:x1875060755371264:12345-192.168.206.40@tcp:9:umount.0 00000020:00000080:1.0:1788197604.227270:0:12087:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292403031e 00000100:00080000:1.0:1788197604.227280:0:12087:0:(import.c:65:import_set_state_nolock()) ffff93c740fec800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788197604.227305:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788197604.227313:0:12087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788197604.227549:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:87c79f47-cb13-4c8a-942c-8f23eb455b39+2:2356:x1875060755371264:12345-192.168.206.40@tcp:9:umount.0 Request processed in 304us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197604.227558:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 72 00000100:00100000:1.0:1788197604.233005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197604.233076:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755371648 00000100:00100000:2.0:1788197604.233096:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755371648 00000100:00100000:2.0:1788197604.233153:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 73 00000100:00100000:2.0:1788197604.233163:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74179aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2356:x1875060755371648:12345-192.168.206.40@tcp:9:umount.0 00000020:00000080:2.0:1788197604.233203:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c2924030586 00000020:00010000:2.0:1788197604.233213:0:6699:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c737059000: total 0 00000100:00080000:2.0:1788197604.233218:0:6699:0:(import.c:65:import_set_state_nolock()) ffff93c73705d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788197604.233265:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788197604.233553:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74179aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+5:2356:x1875060755371648:12345-192.168.206.40@tcp:9:umount.0 Request processed in 390us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197604.233562:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 73 00000020:00010000:1.0:1788197604.233913:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c737059000: total 0 00010000:00010000:1.0:1788197604.233943:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c737059000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788197604.233991:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000106438c3/0x167e6c2924030fc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ae2 expref: 4 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197604.234045:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000195995b/0x167e6c2924030922 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5914 expref: 3 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197604.234059:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c737059000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788197604.234071:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197604.234073:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197604.234075:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197604.241328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197604.241446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755372672 00000100:00100000:0.0:1788197604.241458:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755372672 00000100:00100000:0.0:1788197604.241539:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 240 00000100:00100000:0.0:1788197604.241550:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+23:2356:x1875060755372672:12345-192.168.206.40@tcp:39:umount.0 00000020:00000080:0.0:1788197604.241581:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ffba 00000020:00010000:0.0:1788197604.241598:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c737230000: total 0 00000100:00080000:0.0:1788197604.241603:0:5843:0:(import.c:65:import_set_state_nolock()) ffff93c737233800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788197604.241640:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1788197604.242038:0:8526:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c737230000: total 0 00010000:00010000:3.0:1788197604.242085:0:8526:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c737230000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1788197604.242121:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197604.242125:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788197604.242136:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240305e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d583b expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242164:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c704a46400) 00010000:00010000:3.0:1788197604.242167:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197604.242171:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7420c2a00/0x167e6c2924030284 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d574d expref: 22 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242216:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197604.242219:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788197604.242223:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7c00/0x167e6c2924030c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a09 expref: 21 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242236:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93c7065f6700) 00010000:00010000:3.0:1788197604.242238:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788197604.242242:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7600/0x167e6c29240302f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5769 expref: 20 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242257:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:3.0:1788197604.242259:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788197604.242263:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155c400/0x167e6c2924030ea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5a95 expref: 19 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242277:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:3.0:1788197604.242280:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788197604.242283:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c2924030f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ad4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242295:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93c719ede600) 00010000:00010000:3.0:1788197604.242297:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788197604.242300:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240309a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5937 expref: 17 pid: 5871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242315:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:3.0:1788197604.242317:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788197604.242329:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031a00/0x167e6c2924030803 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58c7 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242344:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c704a46300) 00010000:00010000:3.0:1788197604.242346:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197604.242350:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386600/0x167e6c29240302a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5754 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242363:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:3.0:1788197604.242365:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197604.242369:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924030984 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5930 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242378:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:3.0:1788197604.242380:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788197604.242384:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6a00/0x167e6c2924030fab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5adb expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242394:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:3.0:1788197604.242396:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788197604.242399:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155ca00/0x167e6c29240308e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d58ff expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242409:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93c704a46200) 00010000:00010000:3.0:1788197604.242411:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788197604.242414:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7000/0x167e6c292403090d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d590d expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242426:0:8526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93c7028a4400) 00010000:00010000:3.0:1788197604.242433:0:8526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788197604.242438:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924030f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5acd expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197604.242452:0:8526:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c737230000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1788197604.242465:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197604.242467:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197604.242469:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197604.243172:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c79f47-cb13-4c8a-942c-8f23eb455b39+7:2356:x1875060755372672:12345-192.168.206.40@tcp:39:umount.0 Request processed in 1619us (1848us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788197604.243183:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 240 00010000:00010000:3.0:1788197604.974118:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197605.232626:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7368ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776324096:0@lo:400:kworker.0 00000100:00100000:2.0:1788197605.232698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197605.232773:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197605.232780:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776323968:0@lo:400:kworker.0 00000100:00100000:2.0:1788197605.232807:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197605.232879:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323968 00000100:00100000:2.0:1788197605.232886:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323968 00000100:00100000:2.0:1788197605.232940:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788197605.232951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776323968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197605.233003:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776323968:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197605.233010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788197605.233060:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776323968:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233518:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776323840:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233552:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197605.233583:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776324352:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233606:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197605.233632:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788197605.233638:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776323712:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197605.233681:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776324224:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197605.233739:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323840 00000100:00100000:1.0:1788197605.233743:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323840 00000100:00100000:1.0:1788197605.233770:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324224 00000100:00100000:1.0:1788197605.233773:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324224 00000100:00100000:1.0:1788197605.233789:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788197605.233796:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776323840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233852:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c707c01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875060776323840:12345-0@lo:400:kworker.0 Request processed in 56us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197605.233858:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788197605.233881:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788197605.233887:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776324224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233915:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875060776324224:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197605.233921:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788197605.233949:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875060776324224:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233960:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875060776323840:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.233980:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324096 00000100:00100000:1.0:1788197605.233983:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324096 00000100:00100000:1.0:1788197605.234007:0:12087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324352 00000100:00100000:1.0:1788197605.234010:0:12087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324352 00000100:00100000:1.0:1788197605.234028:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788197605.234033:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776324096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.234068:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776324096:12345-0@lo:400:kworker.0 Request processed in 34us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197605.234074:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788197605.234149:0:12087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788197605.234159:0:12087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776324352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.234253:0:12087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776324352:12345-0@lo:400:kworker.0 Request processed in 95us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197605.234260:0:12087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788197605.234395:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776324352:0@lo:400:kworker.0 00000100:00080000:0.0:1788197605.235243:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788197605.235249:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788197605.235252:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197605.236670:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776323712 00000100:00100000:2.0:1788197605.236682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776323712 00000100:00100000:2.0:1788197605.236755:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788197605.236765:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776323712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197605.236883:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776323712:12345-0@lo:400:kworker.0 Request processed in 120us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197605.236890:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788197605.236949:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788197605.236955:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c73bb82680, transno 4294967324 00000100:00100000:2.0:1788197605.236969:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7368ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776324096:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.238582:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73bf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776323712:0@lo:400:kworker.0 00000100:00100000:1.0:1788197605.545957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197605.546002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197605.546062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197605.546148:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755372800 00000100:00100000:0.0:1788197605.546158:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755372800 00000100:00100000:2.0:1788197605.546163:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755373056 00000100:00100000:2.0:1788197605.546170:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755373056 00000100:00100000:2.0:1788197605.546298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755372928 00000100:00100000:2.0:1788197605.546302:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755372928 00000100:00100000:2.0:1788197605.561459:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1788197605.561482:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+12:2359:x1875060755373056:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197605.561514:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197605.561602:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c74155de00/0x167e6c2924030253 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5738 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197605.561620:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197605.561690:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+11:2359:x1875060755373056:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 218us (15687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197605.561697:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1788197605.561788:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1788197605.561796:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+10:2359:x1875060755372800:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197605.561819:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197605.561860:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c74155c000/0x167e6c292403008c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5689 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197605.561870:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197605.562111:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+9:2359:x1875060755372800:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 315us (16163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197605.562119:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1788197605.562134:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:2.0:1788197605.562140:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+8:2359:x1875060755372928:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197605.562149:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197605.562158:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c700031000/0x167e6c2924030093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d56b3 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197605.562168:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197605.562181:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05358cfc-7070-4d77-b166-215daa591621+7:2359:x1875060755372928:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 42us (16120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197605.562187:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:1.0:1788197605.567321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197605.572085:0:5871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755373312 00000100:00100000:2.0:1788197605.572099:0:5871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755373312 00000100:00100000:2.0:1788197605.572229:0:5871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 241 00000100:00100000:2.0:1788197605.572240:0:5871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+6:2356:x1875060755373312:12345-192.168.206.40@tcp:39:umount.0 00000020:00000080:2.0:1788197605.572281:0:5871:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c29240300a1 00000020:00010000:2.0:1788197605.572288:0:5871:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c7049b9800: total 0 00000100:00080000:2.0:1788197605.572292:0:5871:0:(import.c:65:import_set_state_nolock()) ffff93c7049bd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788197605.572315:0:5871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788197605.572542:0:5871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1778ea05-94ad-4fee-ac82-ea9fc3819e66+5:2356:x1875060755373312:12345-192.168.206.40@tcp:39:umount.0 Request processed in 303us (5228us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788197605.572561:0:5871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 241 00000020:00010000:2.0:1788197605.572602:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c7049b9800: total 0 00010000:00010000:2.0:1788197605.572606:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197605.572641:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c7049b9800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788197605.572672:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede400) 00010000:00010000:2.0:1788197605.572675:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788197605.572684:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c74155cc00/0x167e6c2924030fce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5ae9 expref: 4 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197605.572718:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c7049b9800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788197605.572729:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197605.572731:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197605.572733:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788197605.578549:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788197605.592296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197605.592472:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755373568 00000100:00100000:0.0:1788197605.592481:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755373568 00000100:00100000:0.0:1788197605.592544:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 304 00000100:00100000:0.0:1788197605.592554:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+7:2356:x1875060755373568:12345-192.168.206.40@tcp:251:umount.0 00000020:00000080:0.0:1788197605.592595:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ff97 00000020:00010000:0.0:1788197605.592603:0:5836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c706740800: total 0 00000100:00080000:0.0:1788197605.592608:0:5836:0:(import.c:65:import_set_state_nolock()) ffff93c706741800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788197605.592681:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7063de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05358cfc-7070-4d77-b166-215daa591621+3:2356:x1875060755373568:12345-192.168.206.40@tcp:251:umount.0 Request processed in 128us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197605.592689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 304 00000020:00010000:3.0:1788197605.592860:0:8526:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c706740800: total 0 00010000:00010000:3.0:1788197605.592903:0:8526:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c706740800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788197605.592933:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142600/0x167e6c292403004d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d567b expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197605.592947:0:8526:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c706740800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788197605.592957:0:8526:0:(genops.c:885:class_export_put()) final put ffff93c706740800/05358cfc-7070-4d77-b166-215daa591621 00010000:00010000:3.0:1788197605.592971:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197605.592973:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197605.592975:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788197605.593016:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c706740800/05358cfc-7070-4d77-b166-215daa591621 for MGS 00000020:00000080:2.0:1788197605.593054:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c706741800 for MGS 00000040:00080000:0.0:1788197605.678575:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788197605.678583:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788197605.679042:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788197605.679049:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788197605.742173:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776324480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197605.742247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197605.742380:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324480 00000100:00100000:3.0:1788197605.742387:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324480 00000100:00100000:3.0:1788197605.742433:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788197605.742443:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73bb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776324480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197605.742472:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197605.742530:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73bb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776324480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197605.742536:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788197605.742737:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776324480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788197606.002222:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197606.254280:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776324608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197606.254348:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197606.254460:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324608 00000100:00100000:3.0:1788197606.254480:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324608 00000100:00100000:3.0:1788197606.254539:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788197606.254621:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776324608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197606.254654:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197606.254712:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776324608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197606.254718:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788197606.254943:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776324608:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788197606.832529:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:0.0:1788197606.832537:0:6721:0:(genops.c:885:class_export_put()) final put ffff93c737059000/87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:0.0:1788197606.832561:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c737059000/87c79f47-cb13-4c8a-942c-8f23eb455b39 for lustre-OST0000 00000020:00000080:0.0:1788197606.832610:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c73705d000 for lustre-OST0000 00000001:00100000:2.0:1788197606.841735:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000001:00080000:2.0:1788197606.841748:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1788197606.841760:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000001:00080000:2.0:1788197606.841766:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788197606.841769:0:5863:0:(genops.c:885:class_export_put()) final put ffff93c7049b9800/1778ea05-94ad-4fee-ac82-ea9fc3819e66 00000020:00000080:2.0:1788197606.841793:0:5863:0:(genops.c:885:class_export_put()) final put ffff93c737230000/87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:1.0:1788197606.842238:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c7049b9800/1778ea05-94ad-4fee-ac82-ea9fc3819e66 for lustre-MDT0000 00000020:00000080:1.0:1788197606.842292:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c737230000/87c79f47-cb13-4c8a-942c-8f23eb455b39 for lustre-MDT0000 00000020:00000080:1.0:1788197606.842318:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c7049bd000 for lustre-MDT0000 00000020:00000080:1.0:1788197606.842322:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c737233800 for lustre-MDT0000 00010000:00010000:1.0:1788197607.027048:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788197607.281580:0:12980:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788197607.305236:0:12980:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788197607.305529:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.305545:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.305571:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.305578:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.305611:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788197607.305617:0:12980:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788197607.305642:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788197607.305646:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788197607.305651:0:12980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788197607.305673:0:12980:0:(import.c:65:import_set_state_nolock()) ffff93c70f63d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788197607.305707:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776324736:0@lo:39:umount.0 00000100:00100000:2.0:1788197607.306045:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788197607.306921:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197607.306929:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.306938:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386000 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197607.306941:0:8526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.306950:0:8526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197607.307080:0:8526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197607.307211:0:8526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788197607.307214:0:8526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788197607.307217:0:8526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788197607.307247:0:8526:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.307253:0:8526:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197607.307346:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.307354:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c701386000/0x167e6c292403001c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030023 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.307368:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197607.307370:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197607.307372:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197607.308057:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788197607.308074:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776324864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.308236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197607.308515:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324736 00000100:00100000:0.0:1788197607.308523:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324736 00000100:00100000:0.0:1788197607.308569:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788197607.308587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875060776324736:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788197607.308610:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fda6 00000100:00080000:0.0:1788197607.308617:0:5843:0:(import.c:65:import_set_state_nolock()) ffff93c70f636000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788197607.308681:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875060776324736:12345-0@lo:39:umount.0 Request processed in 95us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197607.308688:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788197607.308698:0:5843:0:(genops.c:885:class_export_put()) final put ffff93c70f633000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788197607.308739:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c70f63d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788197607.308749:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776324736:0@lo:39:umount.0 00010000:00010000:3.0:1788197607.309036:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197607.309237:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324864 00000100:00100000:1.0:1788197607.309241:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324864 00000100:00100000:1.0:1788197607.309339:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788197607.309347:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776324864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197607.309358:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197607.309376:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143e00/0x167e6c2924030023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292403001c expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.309389:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197607.309420:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3314:x1875060776324864:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197607.309426:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788197607.309452:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776324864:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788197607.310377:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788197607.310382:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788197607.310387:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788197607.311392:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c70f633000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788197607.311440:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c70f636000 for lustre-MDT0000 00010000:00010000:0.0:1788197607.314791:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314808:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314816:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314849:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314868:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788197607.314874:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314880:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314898:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314904:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314918:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788197607.314925:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314930:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314936:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314942:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314958:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788197607.314964:0:12980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314971:0:12980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314977:0:12980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.314994:0:12980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197607.315002:0:12980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788197607.315006:0:12980:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788197607.315029:0:12980:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788197607.315033:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788197607.315037:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197607.315042:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788197607.315049:0:12980:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93c741700000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788197607.315054:0:12980:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93c73f147000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788197607.315058:0:12980:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93c704fa3370) has exports, disconnecting them 00000020:00080000:0.0:1788197607.315062:0:12980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c741700000), last request at 1788197605 00000020:00000080:0.0:1788197607.315069:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ff19 00000100:00080000:0.0:1788197607.315083:0:12980:0:(import.c:65:import_set_state_nolock()) ffff93c741702000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788197607.315130:0:12980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c741700000): rc 0 00000020:00000080:0.0:1788197607.315133:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c741700000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788197607.315154:0:12980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93c73f147000), last request at 1788197605 00000020:00000080:0.0:1788197607.315158:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fe4e 00000100:00080000:0.0:1788197607.315164:0:12980:0:(import.c:65:import_set_state_nolock()) ffff93c73f145000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788197607.315171:0:12980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c73f147000): rc 0 00000020:00000080:0.0:1788197607.315173:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73f147000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788197607.315179:0:12980:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f0102ae7ae0 00000100:00080000:0.0:1788197607.315196:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788197607.315199:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788197607.315210:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788197607.315476:0:12980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788197607.315511:0:12980:0:(import.c:65:import_set_state_nolock()) ffff93c717bde000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788197607.315526:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788197607.315528:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788197607.315536:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788197607.315606:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776324992:0@lo:9:umount.0 00000100:00100000:0.0:1788197607.315664:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788197607.315706:0:12980:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788197607.315714:0:12980:0:(import.c:65:import_set_state_nolock()) ffff93c736af5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788197607.315730:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73b8f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776325120:0@lo:9:umount.0 00010000:00010000:3.0:1788197607.315900:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788197607.315908:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.315915:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386400 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197607.315918:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.315926:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197607.315933:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197607.315939:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788197607.315941:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788197607.315943:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788197607.315977:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.315984:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197607.316008:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.316015:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c701386400/0x167e6c292403002a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030031 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.316027:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788197607.316030:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.316036:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030600 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197607.316039:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.316046:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197607.316051:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197607.316056:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788197607.316057:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788197607.316059:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788197607.316072:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.316078:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788197607.316227:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788197607.316238:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316244:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031800 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:1.0:1788197607.316247:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316254:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788197607.316259:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197607.316264:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788197607.316266:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788197607.316279:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788197607.316294:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316299:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788197607.316305:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316312:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700031800/0x167e6c2924030245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292403024c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316321:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197607.316324:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316329:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7420c3a00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:1.0:1788197607.316338:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316345:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788197607.316351:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197607.316355:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788197607.316357:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788197607.316359:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788197607.316371:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316377:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788197607.316382:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316388:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7420c3a00/0x167e6c292402fd05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292402fd0c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316401:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197607.316403:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197607.316405:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788197607.316414:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c741700000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788197607.316450:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73f147000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788197607.316474:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c741702000 for lustre-MDT0000 00000020:00000080:1.0:1788197607.316478:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c73f145000 for lustre-MDT0000 00000100:00100000:1.0:1788197607.316500:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776325248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.316536:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197607.316569:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788197607.316575:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776325632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.316596:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197607.316621:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776325376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.316641:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197607.316656:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197607.316661:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776325504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.316680:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197607.316708:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776325248 00000100:00100000:1.0:1788197607.316714:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776325248 00000100:00100000:1.0:1788197607.316745:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776325632 00000100:00100000:1.0:1788197607.316747:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776325632 00000100:00100000:1.0:1788197607.316875:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776325376 00000100:00100000:1.0:1788197607.316879:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776325376 00000100:00100000:1.0:1788197607.316891:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776325504 00000100:00100000:1.0:1788197607.316894:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776325504 00000100:00100000:1.0:1788197607.316906:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788197607.316914:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+21:3314:x1875060776325248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197607.316925:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197607.316938:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143600/0x167e6c2924030031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292403002a expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.316950:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197607.316990:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+20:3314:x1875060776325248:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197607.316997:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788197607.317010:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788197607.317022:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7057de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+19:3314:x1875060776325632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197607.317029:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197607.317037:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7420c2e00/0x167e6c292402fd0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292402fd05 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.317048:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197607.317068:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7057de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+18:3314:x1875060776325632:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197607.317074:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788197607.317338:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788197607.317395:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93c704fa3370) has no exports 00010000:00010000:3.0:1788197607.317596:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.317606:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700030600/0x167e6c292402ff51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c292402ff58 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197607.317628:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197607.317630:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197607.317632:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197607.317844:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788197607.317852:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+17:3311:x1875060776325376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197607.317861:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197607.317871:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6400/0x167e6c292402ff58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292402ff51 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197607.317881:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197607.317911:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+16:3311:x1875060776325376:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197607.317917:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788197607.317929:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788197607.317934:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+15:3311:x1875060776325504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197607.317940:0:8468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197607.317947:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701387a00/0x167e6c292403024c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c2924030245 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.318053:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197607.318063:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776324992 00000100:00100000:2.0:1788197607.318067:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776324992 00000100:00100000:2.0:1788197607.318115:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776325120 00000100:00100000:2.0:1788197607.318118:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776325120 00000100:00100000:2.0:1788197607.318148:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788197607.318155:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875060776324992:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788197607.318173:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fe9b 00000100:00080000:2.0:1788197607.318180:0:6699:0:(import.c:65:import_set_state_nolock()) ffff93c73f147800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788197607.318207:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788197607.318501:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1875060776324992:12345-0@lo:9:umount.0 Request processed in 346us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197607.318508:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788197607.318521:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788197607.318527:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875060776325120:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788197607.318538:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ff82 00000100:00080000:2.0:1788197607.318544:0:6699:0:(import.c:65:import_set_state_nolock()) ffff93c706743000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788197607.318563:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788197607.318651:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1875060776325120:12345-0@lo:9:umount.0 Request processed in 124us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197607.318657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788197607.318786:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197607.318790:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197607.318818:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c736af5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788197607.318845:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788197607.318847:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788197607.318850:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776325120:0@lo:9:umount.0 00000100:00080000:2.0:1788197607.318863:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c717bde000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788197607.318869:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788197607.318871:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788197607.318873:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73b8f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776324992:0@lo:9:umount.0 00010000:00010000:2.0:1788197607.318893:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197607.319849:0:8468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197607.319884:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d1c03da-de40-4aeb-8e95-9670c13aad9c+14:3311:x1875060776325504:12345-0@lo:103:ldlm_bl.0 Request processed in 1948us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197607.319900:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788197607.319946:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776325632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.320071:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3314:1875060776325248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.320116:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776325504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197607.320123:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3311:1875060776325376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197607.320370:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788197607.345858:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93c704fa3370) has no exports 00000020:00000080:2.0:1788197607.432407:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fd60 00000020:00000080:2.0:1788197607.432422:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c7368df000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788197607.432434:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788197607.432532:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197607.432544:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788197607.432549:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93c73cfb8000) has no exports 00000020:00000080:1.0:1788197607.432557:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c7368df000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788197607.432862:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fd59 00000020:00000080:0.0:1788197607.432869:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73cfc1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788197607.432896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73cfc1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788197607.432930:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.432937:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788197607.432940:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73b83f800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788197607.432942:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73b83f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788197607.432949:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1788197607.433071:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c70315b3c0 - data ffff93c73fe45360/ffff93c736a4e400 00000020:01000000:0.0:1788197607.433190:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c70493a660 - data ffff93c7089a81b0/ffff93c73788c000 00000001:00000004:0.0:1788197607.446603:0:12980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788197607.532630:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788197607.532637:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788197607.532656:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788197607.532667:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788197607.535542:0:7123:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788197607.535551:0:7123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788197607.535564:0:7123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788197607.538115:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788197607.538121:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788197607.539512:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788197607.539517:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788197607.548789:0:8019:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788197607.548796:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788197607.548808:0:8019:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788197607.654362:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fd28 00000020:00000080:2.0:1788197607.654372:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73c2ef800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788197607.655025:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73c2ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788197607.661251:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fd3d 00000020:00000080:2.0:1788197607.661320:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73c2ef000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788197607.661373:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788197607.661381:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788197607.661389:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788197607.661393:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93c704fa4d28) has no exports 00000004:01000000:2.0:1788197607.661572:0:12980:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788197607.661580:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ff7b 00000020:00000080:2.0:1788197607.661585:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c70485c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788197607.661710:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73c2ef000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788197607.661782:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788197607.661787:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788197607.661793:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788197607.661796:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93c706238000) has no exports 00000020:00000080:2.0:1788197607.661803:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ff74 00000020:00000080:2.0:1788197607.661808:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c736af1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788197607.662562:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c70485c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788197607.665563:0:12980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788197607.665570:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788197607.665573:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788197607.665580:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788197607.665594:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788197607.665783:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.665793:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788197607.665799:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fe94 00000020:00000080:0.0:1788197607.665806:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c7368e8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788197607.665812:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788197607.665816:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197607.665848:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788197607.665852:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93c73cff0000) has no exports 00000020:00000080:0.0:1788197607.665858:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fe8d 00000020:00000080:0.0:1788197607.665862:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c717bdb000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788197607.666251:0:12980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788197607.666254:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788197607.666256:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788197607.666259:0:12980:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788197607.666261:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788197607.666466:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.666472:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788197607.666509:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.666513:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788197607.666516:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c70f639000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788197607.666520:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff93c70f639000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788197607.666531:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788197607.666808:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fd44 00000020:00000080:0.0:1788197607.666814:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73c2ed000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788197607.666818:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788197607.666842:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197607.666847:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788197607.666850:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93c73c2f8000) has no exports 00000020:00000080:0.0:1788197607.666870:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.666873:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788197607.666876:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fd4b 00000020:00000080:0.0:1788197607.666888:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73c2e9000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788197607.666895:0:12980:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c706bce800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788197607.666898:0:12980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c706bce800 3 00000020:01000004:0.0:1788197607.666901:0:12980:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c706bce800 from lustre-MDT0000 00000020:00000080:0.0:1788197607.666920:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.666924:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788197607.666927:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73c2ec000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788197607.666929:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73c2ec000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788197607.666934:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788197607.667189:0:12980:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788197607.667193:0:12980:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788197607.667196:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788197607.667199:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197607.667202:0:12980:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788197607.667208:0:12980:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff93c703fda000 3d1c03da-de40-4aeb-8e95-9670c13aad9c 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788197607.667214:0:12980:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93c704fa0000) has exports, disconnecting them 00000020:00080000:0.0:1788197607.667218:0:12980:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93c703fda000), last request at 1788197376 00000020:00000080:0.0:1788197607.667230:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fce9 00000020:00010000:0.0:1788197607.667234:0:12980:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93c703fda000: total 5 00000100:00080000:0.0:1788197607.667238:0:12980:0:(import.c:65:import_set_state_nolock()) ffff93c703fda800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788197607.667254:0:12980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c703fda000): rc 0 00000020:00080000:0.0:1788197607.667258:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93c704fa0000) has no exports 00000100:00100000:0.0:1788197607.667426:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93c706405c00:5836] 2 exiting: rc = 0 00000020:00000080:1.0:1788197607.667696:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c736af1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788197607.667705:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c736af5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788197607.667713:0:36:0:(genops.c:885:class_export_put()) final put ffff93c736af1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788197607.667715:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c736af1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788197607.667725:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788197607.667775:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c7368e8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788197607.667781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c717bdb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788197607.667787:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c717bde000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788197607.667793:0:36:0:(genops.c:885:class_export_put()) final put ffff93c70f63d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788197607.667795:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c70f63d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788197607.667798:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788197607.667871:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73c2ed000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788197607.667876:0:36:0:(genops.c:885:class_export_put()) final put ffff93c73c2ea800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788197607.667877:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73c2ea800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788197607.667881:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788197607.676266:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73c2e9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788197607.676939:0:8526:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93c703fda000: total 0 00010000:00010000:2.0:1788197607.677010:0:8526:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93c703fda000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788197607.677049:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701387c00/0x167e6c292403003f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c2924030038 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677070:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c74155c600/0x167e6c292403023e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c2924030237 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677092:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701386e00/0x167e6c292402fe01 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292402fdfa expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677105:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c701386a00/0x167e6c292402ffeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292402ffe4 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677114:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142200/0x167e6c292402fff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292402fff2 expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677137:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142800/0x167e6c2924030007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c2924030000 expref: 4 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677146:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7a00/0x167e6c2924030230 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c2924030229 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677158:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d7400/0x167e6c2924030015 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x167e6c292403000e expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197607.677168:0:8526:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93c703fda000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788197607.677181:0:8526:0:(genops.c:885:class_export_put()) final put ffff93c703fda000/3d1c03da-de40-4aeb-8e95-9670c13aad9c 00010000:00010000:2.0:1788197607.677195:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197607.677197:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197607.677199:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197607.681533:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93c70638cc00:5835] 1 exiting: rc = 0 00000020:00000080:0.0:1788197607.684002:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c703fda000/3d1c03da-de40-4aeb-8e95-9670c13aad9c for MGS 00000020:00000080:0.0:1788197607.684056:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c703fda800 for MGS 00000100:00100000:2.0:1788197607.694382:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93c704809800:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1788197607.694442:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694450:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694455:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694462:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694468:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694473:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694479:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694516:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694522:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694527:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694532:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694537:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694543:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694548:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694565:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694579:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694586:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694592:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694598:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694604:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694610:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694615:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694621:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694626:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694631:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694636:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694641:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694647:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694653:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694658:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694663:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694668:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694673:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694678:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694683:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694688:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694693:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694698:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694703:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694708:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694714:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694719:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694732:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694737:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694744:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694749:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694754:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694774:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694780:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694785:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694790:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694796:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694802:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694807:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694813:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694819:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694860:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694865:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694870:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694875:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694879:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694884:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694888:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.694893:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788197607.695277:0:12980:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788197607.695280:0:12980:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788197607.696791:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c737080d20 - data ffff93c73ff7c6c0/ffff93c7369f0400 00000020:01000000:1.0:1788197607.696909:0:12980:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c70493a480 - data ffff93c7322fc438/ffff93c7056ac800 00000020:00000080:1.0:1788197607.698214:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fccd 00000020:00000080:1.0:1788197607.698906:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c707828000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788197607.698922:0:12980:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c706bce800 from MGS, refs=2 00000020:01000004:1.0:1788197607.698926:0:12980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c706bce800 2 00000020:01000004:1.0:1788197607.698928:0:12980:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c706bce800 from MGS 00000020:00000080:1.0:1788197607.699031:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788197607.699038:0:12980:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788197607.699042:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c717bde800/MGS 00000020:00000080:1.0:1788197607.699044:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff93c717bde800/MGS for MGS 00000020:01000000:1.0:1788197607.699051:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788197607.699103:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788197607.699107:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788197607.699112:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788197607.699119:0:12980:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93c73c2ea000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788197607.699125:0:12980:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93c73c2f99b8) has exports, disconnecting them 00000020:00080000:1.0:1788197607.699137:0:12980:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93c73c2ea000), last request at 1788197377 00000020:00000080:1.0:1788197607.699141:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fd98 00000020:00080000:1.0:1788197607.699148:0:12980:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c73c2ea000): rc 0 00000020:00000080:1.0:1788197607.699153:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c73c2ea000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788197607.702118:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c707828000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788197607.702141:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73c2ea000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788197607.712136:0:12980:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788197607.712145:0:12980:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788197607.712149:0:12980:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788197607.712155:0:12980:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788197607.712261:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c70f63d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788197607.717050:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.717064:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788197607.717070:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c7368db000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788197607.717075:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff93c7368db000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788197607.717087:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788197607.717145:0:12980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c706bce800 1 00000020:00000080:0.0:1788197607.717151:0:12980:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fcbf 00000020:00000080:0.0:1788197607.717157:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c717bdd800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788197607.717166:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788197607.717170:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197607.717184:0:12980:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788197607.717188:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93c70623cd28) has no exports 00000020:00000080:2.0:1788197607.717299:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c717bdd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788197607.825760:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788197607.825774:0:12980:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788197607.825779:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c706bca800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788197607.825783:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff93c706bca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788197607.825793:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788197607.825917:0:12980:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c706bcd800 00000020:01000000:2.0:1788197607.825940:0:12980:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788197607.825944:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788197607.825948:0:12980:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788197607.825959:0:12980:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93c704fa19b8) has no exports 00000100:00100000:2.0:1788197607.826023:0:5871:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93c705312800:5871] 3 exiting: rc = 0 00000100:00100000:2.0:1788197607.826112:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93c705668200:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1788197607.827652:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93c70563ec00:5843] 2 exiting: rc = 0 00000100:00100000:1.0:1788197607.828745:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93c7053b3200:5842] 1 exiting: rc = 0 00000100:00100000:2.0:1788197607.828931:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828938:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828944:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828949:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828954:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828959:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828964:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828970:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828975:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828980:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828986:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828991:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.828996:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829001:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829006:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829011:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829015:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829020:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829025:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829030:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829036:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829041:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829046:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829051:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829057:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829062:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829068:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829073:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829078:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829083:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829088:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829094:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829112:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829118:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829123:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829129:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829133:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829138:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829143:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829148:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829154:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829159:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829165:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829170:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829176:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829181:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829185:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829191:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829196:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829200:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829205:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829210:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829215:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829220:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829225:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829231:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829236:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829241:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829246:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829251:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829256:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829261:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829281:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.829297:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.836335:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93c70563f600:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788197607.836479:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93c70563f000:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788197607.837502:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837515:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837534:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837540:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837547:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837769:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837776:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837781:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837787:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837793:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837798:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837881:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837889:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837894:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837899:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837905:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837909:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837914:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837919:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837923:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837929:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837934:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837939:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837944:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837949:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837954:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837960:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837966:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837971:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837975:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837981:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837986:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837991:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.837995:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838000:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838006:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838011:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838030:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838035:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838039:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838045:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838049:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838054:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838060:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838064:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838069:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838074:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838079:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838084:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838088:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838093:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838098:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838104:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838110:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838114:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838119:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838125:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838130:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838135:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838140:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838144:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838149:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838154:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.838158:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.839874:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93c7062c1a00:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1788197607.844525:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93c7062c1200:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788197607.844646:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844655:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844661:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844677:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844683:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844688:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844694:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844700:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844718:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844724:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844730:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844735:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844741:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844747:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844753:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844774:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844780:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844785:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844791:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844798:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844814:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844839:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844846:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844852:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844857:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844863:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844868:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844888:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844896:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844901:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844908:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844915:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844920:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844927:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844933:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844939:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844944:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844949:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844956:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844976:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844982:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844987:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.844992:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845006:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845011:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845016:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845022:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845029:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845036:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845041:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845047:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845068:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845075:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845080:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845086:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845091:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845097:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845103:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845110:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845122:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845128:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845134:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845143:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.845157:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.866088:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93c7062c0200:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1788197607.870015:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93c7062c1e00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1788197607.870332:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870341:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870346:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870351:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870356:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870361:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870366:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870371:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870376:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870381:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870386:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870391:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870395:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870399:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870416:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870421:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870426:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870431:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870436:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870442:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870446:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870451:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870455:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870461:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870465:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870470:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870475:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870492:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870499:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870504:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870510:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870515:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870519:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870524:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870529:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870534:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870538:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870543:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870548:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870552:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870567:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870579:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870585:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870590:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870595:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870601:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870606:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870610:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870615:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870628:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870633:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870638:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870643:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870648:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870654:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870659:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870663:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870668:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870673:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870678:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870682:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870687:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870691:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.870696:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871164:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93c7062c0e00:5850] 0 exiting: rc = 1 00000100:00100000:3.0:1788197607.871496:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93c7049b3c00:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1788197607.871704:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871710:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871715:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871720:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871724:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871729:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871734:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871738:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871742:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871746:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871751:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871756:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871760:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871776:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871782:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871787:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871792:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871797:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871802:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871807:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871812:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871816:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871912:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871919:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871923:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871928:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871932:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871945:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871950:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871955:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871960:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871965:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871970:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871974:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871980:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871985:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871990:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.871996:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872002:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872006:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872012:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872016:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872022:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872027:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872032:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872037:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872042:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872047:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872051:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872056:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872062:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872067:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872072:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872077:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872083:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872088:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872093:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872099:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872104:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872109:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872114:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872119:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872131:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.872136:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197607.873578:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93c7049d5400:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1788197607.875230:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93c7049d4200:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1788197607.875312:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875320:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875326:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875331:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875337:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875342:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875347:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875352:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875358:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875363:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875369:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875374:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875379:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875384:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875389:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875393:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875397:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875402:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875407:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875413:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875429:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875434:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875439:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875444:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875449:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875454:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875458:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875462:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875466:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875471:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875476:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875492:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875498:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875503:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875508:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875512:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875517:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875523:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875527:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875532:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875537:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875541:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875545:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875550:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875555:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875560:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875564:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875578:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875584:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875590:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875594:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875600:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875604:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875609:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875614:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875626:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875631:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875636:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875641:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875646:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875651:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875656:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875661:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197607.875666:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197607.881986:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93c7049d5c00:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1788197607.882151:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93c7049d4e00:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1788197607.887966:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93c7049d4c00:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1788197607.888931:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888939:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888944:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888950:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888956:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888961:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888966:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888972:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888978:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888986:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.888992:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889022:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889029:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889034:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889041:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889046:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889051:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889057:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889063:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889069:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889074:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889079:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889087:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889093:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889098:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889104:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889110:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889115:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889121:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889126:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889131:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889136:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889141:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889156:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889162:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889179:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889185:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889189:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889194:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889200:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889205:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889211:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889217:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889223:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889228:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889233:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889239:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889244:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889250:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889255:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889261:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889266:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889272:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889277:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889283:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889288:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889293:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889298:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889304:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889309:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889314:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889320:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889325:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788197607.889330:0:12980:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788197607.897157:0:12980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197607.897169:0:12980:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788197607.897174:0:12980:0:(genops.c:885:class_export_put()) final put ffff93c717bda000/MDS_uuid 00000020:00000080:0.0:1788197607.897178:0:12980:0:(genops.c:844:class_export_destroy()) destroying export ffff93c717bda000/MDS_uuid for MDS 00000020:01000000:0.0:1788197607.897199:0:12980:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788197607.897324:0:12980:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788197608.045928:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788197608.384203:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 87c79f47-cb13-4c8a-942c-8f23eb455b39 00000020:00000080:1.0:1788197608.384212:0:7661:0:(genops.c:885:class_export_put()) final put ffff93c740fe9800/87c79f47-cb13-4c8a-942c-8f23eb455b39 00000001:00100000:1.0:1788197608.384239:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788197608.384241:0:7661:0:(genops.c:885:class_export_put()) final put ffff93c706743800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788197608.384640:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c740fe9800/87c79f47-cb13-4c8a-942c-8f23eb455b39 for lustre-OST0001 00000020:00000080:2.0:1788197608.384690:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c706743800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788197608.384710:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c740fec800 for lustre-OST0001 00000020:00000080:2.0:1788197608.384714:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c706743000 for lustre-OST0001 00010000:00010000:3.0:1788197609.070982:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197610.093903:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197610.351193:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197610.351212:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776325760:0@lo:400:kworker.0 00000400:00000100:1.0:1788197610.351272:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060776325760 offset 0 length 224: 4 00000100:00100000:1.0:1788197610.351331:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776325888:0@lo:400:kworker.0 00000400:00000100:1.0:1788197610.351357:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060776325888 offset 0 length 224: 4 00000100:00100000:1.0:1788197610.351374:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197610.351380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776326016:0@lo:400:kworker.0 00000400:00000100:1.0:1788197610.351397:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060776326016 offset 0 length 224: 4 00000020:01000004:2.0:1788197611.080480:0:13132:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788197611.098038:0:13132:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788197611.098083:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197611.098095:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197611.098102:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197611.098109:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197611.098128:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788197611.098133:0:13132:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788197611.098153:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788197611.098172:0:13132:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c7417fd880 x1875060776325888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197611.098191:0:13132:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788197611.098197:0:13132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788197611.098359:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776325888:0@lo:400:kworker.0 00000100:00080000:2.0:1788197611.098422:0:13132:0:(import.c:65:import_set_state_nolock()) ffff93c604c39000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788197611.098503:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197611.098510:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197611.098517:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6000 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197611.098521:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197611.098529:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197611.098537:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197611.098542:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788197611.098544:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788197611.098546:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788197611.098581:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197611.098597:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197611.098620:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197611.098626:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d6000/0x167e6c2924030000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x167e6c2924030007 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197611.098636:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197611.098637:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197611.098639:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197611.098678:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776326272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197611.098732:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197611.098975:0:8468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776326272 00000100:00100000:3.0:1788197611.099042:0:8468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776326272 00000100:00100000:3.0:1788197611.099084:0:8468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788197611.099091:0:8468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875060776326272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788197611.099097:0:8468:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788197611 with bad export cookie 1620851839853591785 00000100:00100000:0.0:1788197611.099497:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875060776326144:0@lo:39:umount.0 00000400:00000100:0.0:1788197611.099527:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060776326144 offset 0 length 224: 4 00000100:00100000:3.0:1788197611.110164:0:8468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875060776326272:12345-0@lo:103:ldlm_bl.0 Request processed in 11062us (11422us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788197611.110177:0:8468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788197611.110358:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788197611.110364:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93c703fa1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788197611.110368:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788197611.117579:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.140@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788197611.117584:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788197611.117592:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c7417fc700 x1875060776325760/t0(0) o400->MGC192.168.206.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788197626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197611.117606:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c73c283800 x1875060776326272/t0(0) o103->MGC192.168.206.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788197627 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788197611.117616:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788197611.117618:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788197611.117619:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788197611.117622:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93c703fa1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788197611.117627:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.206.140@tcp: connect to NID 0@lo last attempt 172 00000100:00080000:2.0:1788197611.117634:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.206.140@tcp: import ffff93c703fa1000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1788197611.117662:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c7417fad80 x1875060776326400/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788197611.117780:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3310:1875060776326400:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788197611.117857:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060776326400 offset 0 length 520: 4 00000100:00100000:2.0:1788197611.118055:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776325760:0@lo:400:kworker.0 00000100:00100000:2.0:1788197611.118075:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3313:1875060776326272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788197611.118358:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788197611.970513:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788197611.970522:0:6721:0:(genops.c:885:class_export_put()) final put ffff93c73f140000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788197611.971221:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73f140000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788197611.971348:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c73f147800 for lustre-OST0000 00010000:00010000:2.0:1788197612.145123:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197613.166088:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197614.190010:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197615.214032:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788197615.469950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788197615.469960:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788197615.470096:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788197615.470117:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776326528:0@lo:400:kworker.0 00000400:00000100:3.0:1788197615.470171:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060776326528 offset 0 length 224: 4 00010000:00010000:3.0:1788197616.242610:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788197616.495732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788197616.495742:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788197616.496027:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197616.507855:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776326656:0@lo:400:kworker.0 00000400:00000100:2.0:1788197616.507928:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060776326656 offset 0 length 224: 4 00010000:00010000:3.0:1788197617.264770:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197618.285992:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197619.310125:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197620.334373:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197621.357939:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788197621.617174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788197621.617184:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788197621.617421:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776326784:0@lo:400:kworker.0 00000400:00000100:1.0:1788197621.617471:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060776326784 offset 0 length 224: 4 00000100:00100000:2.0:1788197621.617676:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788197611/real 1788197611] req@ffff93c7417fad80 x1875060776326400/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788197621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197621.617697:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c7417fad80 x1875060776326400/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788197621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197621.617707:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788197611/real 1788197611] req@ffff93c7417f9180 x1875060776326144/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788197621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197621.617799:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c7417f9180 x1875060776326144/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788197621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788197621.617814:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c703fa1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788197621.617848:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788197621.617852:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3310:1875060776326400:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788197621.617858:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c604c39000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788197621.617875:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875060776326144:0@lo:39:umount.0 00000100:00080000:1.0:1788197621.617941:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788197621.617945:0:13132:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788197621.617950:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788197621.620513:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197621.620532:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197621.620540:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197621.620547:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788197621.620673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788197621.620678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788197621.620682:0:37:0:(import.c:65:import_set_state_nolock()) ffff93c703fa1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788197621.620688:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.140@tcp: connect to NID 0@lo last attempt 407 00000100:00080000:0.0:1788197621.620693:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788197621.620698:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.140@tcp: import ffff93c703fa1000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1788197621.620728:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c736f48000 x1875060776326912/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788197621.622115:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3310:1875060776326912:0@lo:250:kworker.0 00000400:00000100:2.0:1788197621.622172:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875060776326912 offset 0 length 520: 4 00010000:00010000:1.0:1788197621.624174:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788197621.624201:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197621.624235:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197621.624242:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197621.624249:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197621.624278:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788197621.624283:0:13132:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788197621.624313:0:13132:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788197621.624317:0:13132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788197621.624322:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788197621.624328:0:13132:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788197621.624332:0:13132:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93c73cfbcd28) has no exports 00000020:00080000:1.0:1788197621.624358:0:13132:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93c73cfbcd28) has no exports 00010000:00010000:3.0:1788197621.625804:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197621.625818:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.625842:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742143200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197621.625846:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.625856:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197621.625864:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197621.625870:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788197621.625873:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788197621.625876:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788197621.625895:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c703fa1000 00010000:00010000:3.0:1788197621.625899:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.625905:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742143200/0x167e6c292403000e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c2924030015 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.625920:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197621.625924:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.625929:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030400 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197621.625932:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.625958:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197621.625964:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197621.625970:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788197621.625972:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788197621.625974:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788197621.625990:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c703fa1000 00010000:00010000:3.0:1788197621.625993:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.625999:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c700030400/0x167e6c2924030237 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292403023e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197621.626007:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197621.626009:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197621.626011:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197621.626139:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788197621.640276:0:13132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c704e18900 - data ffff93c73fe3c000/ffff93c736d3c000 00000020:01000000:1.0:1788197621.640390:0:13132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c7066f1c00 - data ffff93c725b79d80/ffff93c604f94000 00100000:10000000:1.0:1788197621.653864:0:13132:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788197621.709521:0:13132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fe1d 00000020:00000080:3.0:1788197621.709531:0:13132:0:(genops.c:885:class_export_put()) final put ffff93c73f146000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788197621.709549:0:13132:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c70f634000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788197621.709553:0:13132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c70f634000 2 00000020:01000004:3.0:1788197621.709557:0:13132:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c70f634000 from lustre-OST0000 00000020:00000080:3.0:1788197621.709580:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788197621.709589:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788197621.709592:0:13132:0:(genops.c:885:class_export_put()) final put ffff93c736928800/lustre-OST0000_UUID 00000020:00000080:3.0:1788197621.709595:0:13132:0:(genops.c:844:class_export_destroy()) destroying export ffff93c736928800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788197621.709601:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788197621.709638:0:13132:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788197621.709651:0:13132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788197621.709654:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788197621.709658:0:13132:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788197621.709664:0:13132:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93c73f141800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788197621.709670:0:13132:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff93c73c2fcd28) has exports, disconnecting them 00000020:00080000:3.0:1788197621.709689:0:13132:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93c73f141800), last request at 1788197396 00000020:00000080:3.0:1788197621.709693:0:13132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fe47 00000020:00080000:3.0:1788197621.709701:0:13132:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c73f141800): rc 0 00000020:00000080:3.0:1788197621.709705:0:13132:0:(genops.c:885:class_export_put()) final put ffff93c73f141800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788197621.710367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73f146000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788197621.710378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73f141800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788197621.713929:0:13132:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788197621.713937:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788197621.713940:0:13132:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788197621.713947:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788197621.714091:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c604c39000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788197621.714148:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197621.714165:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788197621.714170:0:13132:0:(genops.c:885:class_export_put()) final put ffff93c604c38000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788197621.714174:0:13132:0:(genops.c:844:class_export_destroy()) destroying export ffff93c604c38000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788197621.714182:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788197621.714241:0:13132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c70f634000 1 00000020:00000080:0.0:1788197621.714246:0:13132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fdd7 00000020:00000080:0.0:1788197621.714252:0:13132:0:(genops.c:885:class_export_put()) final put ffff93c706702800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788197621.714267:0:13132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788197621.714272:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197621.714276:0:13132:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788197621.714280:0:13132:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93c73cff3370) has no exports 00000020:00000080:1.0:1788197621.714442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93c706702800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788197621.783518:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197621.783533:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788197621.783539:0:13132:0:(genops.c:885:class_export_put()) final put ffff93c70f630000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788197621.783543:0:13132:0:(genops.c:844:class_export_destroy()) destroying export ffff93c70f630000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788197621.783555:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788197621.784338:0:13132:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c70f632000 00000020:02000400:0.0:1788197621.784379:0:13132:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788197622.381982:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197623.406152:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197624.430147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788197624.564101:0:13290:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788197624.576381:0:13290:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788197624.576470:0:13290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197624.576484:0:13290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197624.576492:0:13290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197624.576500:0:13290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197624.576571:0:13290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788197624.576577:0:13290:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788197624.576612:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788197624.576623:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c7417fce00 x1875060776326016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197624.576650:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c7417fc000 x1875060776326528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197624.576681:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c736f48380 x1875060776326656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197624.576693:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c736f4bb80 x1875060776326784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197637 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197624.576700:0:13290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788197624.576705:0:13290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788197624.576734:0:13290:0:(import.c:65:import_set_state_nolock()) ffff93c737236000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788197624.576760:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875060776327040:0@lo:39:umount.0 00000400:00000100:2.0:1788197624.576804:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875060776327040 offset 0 length 224: 4 00000100:00100000:1.0:1788197624.577090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776326016:0@lo:400:kworker.0 00000100:00100000:1.0:1788197624.577119:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776326784:0@lo:400:kworker.0 00000100:00100000:1.0:1788197624.577126:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776326656:0@lo:400:kworker.0 00010000:00010000:3.0:1788197624.577637:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197624.577646:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197624.577655:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197624.577658:0:8526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197624.577667:0:8526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197624.577675:0:8526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197624.577680:0:8526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788197624.577683:0:8526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788197624.577686:0:8526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788197624.577698:0:8526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c703fa1000 00010000:00010000:3.0:1788197624.577702:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197624.577721:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d7200/0x167e6c292402ffe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292402ffeb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197624.577973:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197624.577976:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197624.577978:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197624.578011:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776326528:0@lo:400:kworker.0 00010000:00010000:3.0:1788197625.454122:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197626.478335:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788197626.734089:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788197626.734098:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788197627.501992:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197628.533689:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197629.550872:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197630.574076:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197631.600223:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788197631.858148:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788197631.858156:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788197632.623430:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197633.646151:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197634.670108:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197634.797944:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788197624/real 1788197624] req@ffff93c7417f9180 x1875060776327040/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788197634 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197634.797974:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c7417f9180 x1875060776327040/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788197634 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788197634.798015:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c737236000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788197634.798039:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875060776327040:0@lo:39:umount.0 00000100:00080000:2.0:1788197634.798146:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788197634.798152:0:13290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788197634.798157:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788197634.799105:0:13290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799119:0:13290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799127:0:13290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799135:0:13290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799159:0:13290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197634.799165:0:13290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799185:0:13290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799191:0:13290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799197:0:13290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197634.799217:0:13290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788197634.799221:0:13290:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788197634.799241:0:13290:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788197634.799244:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788197634.799248:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788197634.799253:0:13290:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788197634.799257:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93c73cfbb370) has no exports 00000020:00080000:2.0:1788197634.799276:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93c73cfbb370) has no exports 00010000:00010000:3.0:1788197634.799358:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197634.799367:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799376:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7800 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197634.799380:0:8526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799390:0:8526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197634.799398:0:8526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197634.799404:0:8526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788197634.799407:0:8526:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788197634.799409:0:8526:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788197634.799422:0:8526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c703fa1000 00010000:00010000:3.0:1788197634.799427:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799433:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d7800/0x167e6c292402fff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292402fff9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799454:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197634.799457:0:8526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799473:0:8526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ce00 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197634.799477:0:8526:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799484:0:8526:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197634.799490:0:8526:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197634.799495:0:8526:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788197634.799497:0:8526:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788197634.799499:0:8526:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788197634.799506:0:8526:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c703fa1000 00010000:00010000:3.0:1788197634.799509:0:8526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799516:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c74155ce00/0x167e6c2924030229 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c2924030230 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197634.799530:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197634.799532:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197634.799534:0:8526:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788197634.800979:0:13290:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c704e18b40 - data ffff93c73fe3c0d8/ffff93c736d3d000 00010000:00010000:0.0:1788197634.801286:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788197634.806232:0:13290:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93c711874060 - data ffff93c725a12510/ffff93c736a56c00 00100000:10000000:3.0:1788197634.812915:0:13290:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788197634.843978:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fee8 00000020:00000080:0.0:1788197634.843988:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c741727800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788197634.844004:0:13290:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c736929000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788197634.844008:0:13290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c736929000 2 00000020:01000004:0.0:1788197634.844011:0:13290:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93c736929000 from lustre-OST0001 00000020:00000080:0.0:1788197634.844046:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197634.844056:0:13290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788197634.844059:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c736f7a800/lustre-OST0001_UUID 00000020:00000080:0.0:1788197634.844063:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff93c736f7a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788197634.844072:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788197634.844368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c741727800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788197634.844458:0:13290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3d1c03da-de40-4aeb-8e95-9670c13aad9c->MGS 00010000:00010000:0.0:1788197634.844474:0:13290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292402fe01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788197634.844487:0:13290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292402fe01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197634.844494:0:13290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788197634.844497:0:13290:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788197634.844500:0:13290:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788197634.844513:0:13290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c703fa1000 00010000:00010000:0.0:1788197634.844517:0:13290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d6600/0x167e6c292402fdfa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292402fe01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197634.844532:0:13290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x167e6c292403003f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788197634.844557:0:13290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x167e6c292403003f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197634.844563:0:13290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788197634.844566:0:13290:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788197634.844567:0:13290:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788197634.844577:0:13290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93c703fa1000 00010000:00010000:0.0:1788197634.844580:0:13290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742142400/0x167e6c2924030038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x167e6c292403003f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788197634.844596:0:13290:0:(import.c:65:import_set_state_nolock()) ffff93c703fa1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788197634.844599:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788197634.844602:0:13290:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788197634.844603:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788197634.844607:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788197634.844618:0:13290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93c736f48000 x1875060776326912/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788197636 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788197634.844685:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788197634.844689:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1788197634.846358:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3d1c03da-de40-4aeb-8e95-9670c13aad9c:3310:1875060776326912:0@lo:250:kworker.0 10000000:01000000:0.0:1788197634.846526:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788197634.846537:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402fcdb 00000020:00000080:0.0:1788197634.846544:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c717bdc000/3d1c03da-de40-4aeb-8e95-9670c13aad9c 00000020:01000000:0.0:1788197634.846564:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.140@tcp (flags='') 00000020:00000080:0.0:1788197634.846582:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197634.846590:0:13290:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788197634.846594:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93c70623b370) has no exports 00000020:00000080:2.0:1788197634.847252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c717bdc000/3d1c03da-de40-4aeb-8e95-9670c13aad9c for MGC192.168.206.140@tcp 10000000:01000000:2.0:1788197634.848166:0:5839:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788197634.848422:0:13290:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.140@tcp: client import never connected 00000100:00080000:0.0:1788197634.848427:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788197634.848431:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788197634.848434:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788197634.848448:0:13290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788197634.848497:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788197634.848506:0:13290:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.140@tcp (uuid 3d1c03da-de40-4aeb-8e95-9670c13aad9c) 00000020:01000000:0.0:1788197634.848514:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788197634.848518:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788197634.848522:0:13290:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788197634.848529:0:13290:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93c737230800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788197634.848535:0:13290:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff93c73cff19b8) has exports, disconnecting them 00000020:00080000:0.0:1788197634.848539:0:13290:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93c737230800), last request at 1788197418 00000020:00000080:0.0:1788197634.848543:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402ff12 00000020:00080000:0.0:1788197634.848558:0:13290:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93c737230800): rc 0 00000020:00000080:0.0:1788197634.848563:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c737230800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788197634.849092:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c703fa1000 for MGC192.168.206.140@tcp 00000020:00000080:2.0:1788197634.849098:0:36:0:(genops.c:885:class_export_put()) final put ffff93c70782f800/3d1c03da-de40-4aeb-8e95-9670c13aad9c 00000020:00000080:2.0:1788197634.849101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c70782f800/3d1c03da-de40-4aeb-8e95-9670c13aad9c for MGC192.168.206.140@tcp 00000020:01000000:2.0:1788197634.849112:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.140@tcp (3d1c03da-de40-4aeb-8e95-9670c13aad9c) 00000020:00000080:2.0:1788197634.849328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c737230800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788197634.850784:0:13290:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788197634.850799:0:13290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788197634.850803:0:13290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788197634.850814:0:13290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788197634.850880:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93c737236000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788197634.851128:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788197634.851878:0:8526:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788197634.852168:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788197634.852551:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93c7062f5e00:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1788197634.852605:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93c703cf2200:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1788197634.857751:0:8525:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff93c7057e3200:8525] 2 exiting: rc = 0 00000100:00100000:1.0:1788197634.858233:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.858491:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93c711337a00:5827] 1 exiting: rc = 0 00000100:00100000:1.0:1788197634.858553:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93c711336600:5828] 2 exiting: rc = 0 00000100:00100000:2.0:1788197634.858769:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93c711337400:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1788197634.859730:0:8468:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93c7057e2800:8468] 3 exiting: rc = 0 00000100:00100000:1.0:1788197634.861173:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861184:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861190:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861196:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861213:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861219:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861225:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861230:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861235:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861243:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861249:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861255:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861260:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861266:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861271:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861276:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861282:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861313:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861320:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861326:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861331:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861349:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861354:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861456:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861462:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861467:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861472:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861477:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861495:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861500:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861504:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861509:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861514:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861519:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861524:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861530:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861535:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861540:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861545:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861550:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861556:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861560:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861565:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861570:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861576:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861581:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861586:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861591:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861596:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861601:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861606:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861612:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861617:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861621:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861626:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861631:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861636:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861641:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861646:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861651:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861657:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861663:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861668:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.861681:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788197634.862731:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788197634.862741:0:13290:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788197634.862747:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c73f142000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788197634.862751:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73f142000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788197634.862758:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788197634.862801:0:13290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c736929000 1 00000020:00000080:2.0:1788197634.862806:0:13290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x167e6c292402feb7 00000020:00000080:2.0:1788197634.862812:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c73f111800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788197634.862845:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788197634.862856:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93c73f111800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788197634.862875:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788197634.863603:0:13290:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788197634.863608:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93c73c2fb370) has no exports 00000020:00000080:1.0:1788197634.888049:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788197634.888065:0:13290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788197634.888071:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c736929800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788197634.888076:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff93c736929800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788197634.888090:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788197634.888422:0:13290:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93c73692f000 00000020:01000000:1.0:1788197634.888445:0:13290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788197634.888450:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788197634.888455:0:13290:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788197634.888459:0:13290:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93c73cfb99b8) has no exports 00000020:00000080:1.0:1788197634.888485:0:13290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788197634.888492:0:13290:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788197634.888494:0:13290:0:(genops.c:885:class_export_put()) final put ffff93c706702000/OSS_uuid 00000020:00000080:1.0:1788197634.888497:0:13290:0:(genops.c:844:class_export_destroy()) destroying export ffff93c706702000/OSS_uuid for OSS 00000020:01000000:1.0:1788197634.888501:0:13290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788197634.888583:0:12087:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff93c727161800:12087] 4 exiting: rc = 0 00000100:00100000:1.0:1788197634.888677:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93c7049d4000:6698] 1 exiting: rc = 0 00000100:00080000:2.0:1788197634.891028:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788197634.891075:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93c7370d3e00:6696] 0 exiting: rc = 1 00000100:00100000:2.0:1788197634.891358:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93c710ba0600:6699] 2 exiting: rc = 0 00000100:00100000:2.0:1788197634.891406:0:8021:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93c73b872a00:8021] 3 exiting: rc = 0 00000100:00100000:1.0:1788197634.891564:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891573:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891584:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891591:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891595:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891600:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891605:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891609:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891614:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891619:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891623:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891629:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891634:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891639:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891645:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891650:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891667:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891673:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891678:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891682:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891687:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891693:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891699:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891705:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891713:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891722:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891734:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891740:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891785:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891793:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891799:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891804:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891809:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.891815:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893837:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893869:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893875:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893881:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893964:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893972:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893976:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893982:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893987:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893993:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.893998:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894004:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894009:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894015:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894020:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894025:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894030:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894050:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894054:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894059:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894064:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894070:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894077:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894082:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894087:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894093:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894098:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894104:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894108:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.894113:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197634.895058:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93c703edca00:6701] 1 exiting: rc = 0 00000100:00100000:2.0:1788197634.897592:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93c703edcc00:6700] 0 exiting: rc = 1 00000100:00100000:1.0:1788197634.899623:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899635:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899639:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899644:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899649:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899653:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899658:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899663:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899667:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899672:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899676:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899691:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899698:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899703:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899708:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899712:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899717:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899721:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899726:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899731:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899735:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899740:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899755:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899775:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899783:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899788:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899793:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899797:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899802:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899807:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899811:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899816:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899835:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899842:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899847:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899852:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899856:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899861:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899866:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899871:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899876:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899881:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899885:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899890:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899894:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899899:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899904:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899908:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899914:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899922:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899927:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899932:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899936:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899941:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899945:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899950:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899955:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899968:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899973:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899978:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899983:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899988:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.899992:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.900002:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197634.901314:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93c703edda00:6704] 2 exiting: rc = 0 00000100:00100000:2.0:1788197634.901716:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93c7049d5200:6702] 0 exiting: rc = 1 00000100:00100000:1.0:1788197634.901984:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93c7049d4600:6703] 1 exiting: rc = 0 00000100:00100000:1.0:1788197634.902036:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902043:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902051:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902056:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902061:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902067:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902073:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902078:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902083:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902088:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902093:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902099:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902104:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902110:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902115:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902121:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902126:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902132:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902137:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902141:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902146:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902151:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902156:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902161:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902166:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902171:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902191:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902209:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902214:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902220:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902225:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902229:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902285:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902291:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902297:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902303:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902308:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902314:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902319:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902324:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902329:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902345:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902351:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902356:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902362:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902367:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902372:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902377:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902382:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902387:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902396:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902415:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902420:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902425:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902430:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902434:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902439:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902444:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902450:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902527:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902535:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902540:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902552:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.902564:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197634.907476:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93c703edc200:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1788197634.907590:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93c703edde00:6706] 1 exiting: rc = 0 00000100:00100000:1.0:1788197634.908105:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908113:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908119:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908124:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908129:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908134:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908140:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908145:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908151:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908156:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908161:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908167:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908172:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908177:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908183:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908188:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908194:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908199:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908204:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908209:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908214:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908219:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908225:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908230:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908235:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908240:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908245:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908250:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908255:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908260:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908265:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908270:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908278:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908295:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908301:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908306:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908311:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908316:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908321:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908327:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908332:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908348:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908353:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908358:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908363:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908367:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908372:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908377:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908383:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908389:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908394:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908400:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908407:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908412:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908426:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908432:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908437:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908450:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908912:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908923:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908929:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908934:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908940:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.908945:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788197634.916964:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93c73696d800:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1788197634.917658:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93c73696c600:6708] 1 exiting: rc = 0 00000100:00100000:1.0:1788197634.918214:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918224:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918242:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918250:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918266:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918273:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918280:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918285:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918291:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918297:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918303:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918308:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918314:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918320:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918357:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918364:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918371:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918377:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918384:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918390:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918398:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918406:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918413:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918431:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918437:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918444:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918465:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918472:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918478:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918484:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918490:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918496:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918502:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918507:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918512:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918517:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918523:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918539:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918560:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918573:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918579:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918584:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918598:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918604:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918610:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918622:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918629:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918635:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918641:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918648:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918669:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918676:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918682:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918687:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918692:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918698:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918704:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918710:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918716:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918721:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918727:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918734:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918740:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788197634.918756:0:13290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788197634.946148:0:13290:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788197650.003546:0:13907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788197658.593265:0:14368:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788197658.593270:0:14368:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788197658.593428:0:14368:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c6054e9800 00000020:01000004:3.0:1788197658.593443:0:14368:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788197658.593449:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788197658.593463:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93c73c2fb370) 00000020:00000080:3.0:1788197658.593475:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788197658.638617:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788197658.642589:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788197658.643285:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 425: rc = 0 00100000:10000000:1.0:1788197658.643702:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 425: rc = 0 00100000:10000000:1.0:1788197658.643795:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 425: rc = 0 00100000:10000000:1.0:1788197658.643918:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 425: rc = 0 00100000:10000000:1.0:1788197658.644094:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 425: rc = 0 00100000:10000000:1.0:1788197658.644694:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788197658.644779:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 425: rc = 0 00100000:10000000:1.0:1788197658.646066:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 513: rc = 0 00100000:10000000:1.0:1788197658.648126:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 651: rc = 0 00100000:10000000:1.0:1788197658.648553:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 651: rc = 0 00100000:10000000:1.0:1788197658.649754:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 431: rc = 0 00100000:10000000:1.0:1788197658.650280:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 431: rc = 0 00100000:10000000:1.0:1788197658.650983:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 431: rc = 0 00100000:10000000:1.0:1788197658.651727:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 431: rc = 0 00100000:10000000:1.0:1788197658.652541:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 431: rc = 0 00100000:10000000:1.0:1788197658.653068:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 431: rc = 0 00100000:10000000:1.0:1788197658.654154:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 431: rc = 0 00100000:10000000:1.0:1788197658.655009:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 431: rc = 0 00100000:10000000:1.0:1788197658.655251:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 431: rc = 0 00100000:10000000:1.0:1788197658.655942:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 431: rc = 0 00100000:10000000:1.0:1788197658.656225:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 431: rc = 0 00100000:10000000:1.0:1788197658.657603:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 431: rc = 0 00100000:10000000:1.0:1788197658.658582:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 783: rc = 0 00100000:10000000:1.0:1788197658.658934:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 783: rc = 0 00100000:10000000:1.0:1788197658.659541:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 783: rc = 0 00100000:10000000:1.0:1788197658.660095:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 783: rc = 0 00100000:10000000:1.0:1788197658.660746:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 783: rc = 0 00100000:10000000:1.0:1788197658.661097:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 783: rc = 0 00100000:10000000:1.0:1788197658.661755:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 783: rc = 0 00100000:10000000:1.0:1788197658.662224:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 783: rc = 0 00100000:10000000:1.0:1788197658.662891:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 783: rc = 0 00100000:10000000:1.0:1788197658.663541:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 783: rc = 0 00100000:10000000:1.0:1788197658.663953:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 783: rc = 0 00100000:10000000:1.0:1788197658.664302:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 783: rc = 0 00100000:10000000:1.0:1788197658.664937:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 783: rc = 0 00100000:10000000:1.0:1788197658.665530:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 783: rc = 0 00100000:10000000:0.0:1788197658.666230:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 783: rc = 0 00100000:10000000:0.0:1788197658.666871:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 783: rc = 0 00100000:10000000:0.0:1788197658.667267:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 783: rc = 0 00100000:10000000:0.0:1788197658.668070:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 783: rc = 0 00100000:10000000:0.0:1788197658.669162:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 783: rc = 0 00100000:10000000:0.0:1788197658.669480:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 783: rc = 0 00100000:10000000:0.0:1788197658.669738:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 783: rc = 0 00100000:10000000:0.0:1788197658.670292:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 783: rc = 0 00100000:10000000:0.0:1788197658.672123:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 783: rc = 0 00100000:10000000:0.0:1788197658.674377:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 783: rc = 0 00100000:10000000:0.0:1788197658.674646:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 783: rc = 0 00100000:10000000:0.0:1788197658.675427:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 783: rc = 0 00100000:10000000:0.0:1788197658.675675:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 783: rc = 0 00100000:10000000:0.0:1788197658.675956:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 783: rc = 0 00100000:10000000:0.0:1788197658.676969:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 783: rc = 0 00100000:10000000:0.0:1788197658.678123:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 783: rc = 0 00100000:10000000:0.0:1788197658.680763:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 783: rc = 0 00100000:10000000:0.0:1788197658.681118:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 783: rc = 0 00100000:10000000:0.0:1788197658.681535:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 655: rc = 0 00100000:10000000:0.0:1788197658.682051:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788197658.682240:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 652: rc = 0 00100000:10000000:0.0:1788197658.682427:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788197658.682498:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 652: rc = 0 00100000:10000000:0.0:1788197658.682688:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788197658.682756:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 652: rc = 0 00100000:10000000:0.0:1788197658.683131:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788197658.683196:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:0.0:1788197658.683390:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788197658.688918:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:0.0:1788197658.689459:0:14368:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788197658.689520:0:14368:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00000020:00000080:0.0:1788197658.689916:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788197658.689923:0:14368:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788197658.689932:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c2924030fdc 00000020:01000004:0.0:1788197658.689938:0:14368:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788197658.689942:0:14368:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788197658.689947:0:14368:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6054e9800 from MGS 00000020:01000004:0.0:1788197658.689950:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788197658.689959:0:14368:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93c7062399b8) 00000020:00000080:0.0:1788197658.689966:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788197658.690075:0:14368:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6054e9800 from MGS, refs=2 00080000:01000000:0.0:1788197658.690080:0:14368:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788197658.690084:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c2924030fea 00000100:00100000:0.0:1788197658.690406:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788197658.690532:0:14368:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788197658.690537:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788197658.691235:0:14368:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788197658.691243:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788197658.692200:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197658.692474:0:14368:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788197658.692480:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788197658.693081:0:14368:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788197658.693088:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788197658.703000:0:14368:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788197658.703014:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788197658.703803:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197658.703806:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197658.703808:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197658.712943:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197658.713036:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197658.713041:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197658.713948:0:14368:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788197658.716096:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788197658.725142:0:14368:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788197658.725158:0:14368:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788197658.725160:0:14368:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788197658.726761:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788197658.726907:0:14368:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788197658.727028:0:14368:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788197658.727648:0:14368:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788197658.728081:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197658.728273:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788197658.728279:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788197658.728803:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788197658.728810:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788197658.729223:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788197658.729229:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788197658.729970:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788197658.729992:0:14368:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.140@tcp' 00000020:01000004:3.0:1788197658.729994:0:14368:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788197658.730024:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.140@tcp (typ=mgc) 00000020:00000080:3.0:1788197658.730037:0:14368:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.140@tcp (ffff93c73c2fcd28) 00000020:00000080:3.0:1788197658.730056:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788197658.730123:0:14368:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c6054e9000@MGC192.168.206.140@tcp: add connection 192.168.206.140@tcp at head 00010000:00010000:3.0:1788197658.730355:0:14368:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.140@tcp-0 is initialized 00000040:01000000:3.0:1788197658.730361:0:14368:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788197658.730539:0:14381:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788197658.739953:0:14382:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788197658.740051:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.140@tcp (uuid cb9dfa30-4633-465a-85d4-89e35609b060) 00000020:00000080:3.0:1788197658.740073:0:14368:0:(genops.c:1385:class_connect()) connect: client cb9dfa30-4633-465a-85d4-89e35609b060, cookie 0x167e6c2924030ff8 00000100:00080000:3.0:1788197658.740085:0:14368:0:(import.c:510:import_select_connection()) MGC192.168.206.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788197658.740090:0:14368:0:(import.c:624:import_select_connection()) MGC192.168.206.140@tcp: import ffff93c6054e9000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197658.740122:0:14368:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c280700 x1875060776327168/t0(0) o250->MGC192.168.206.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788197658.740181:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb9dfa30-4633-465a-85d4-89e35609b060:3310:1875060776327168:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788197658.740264:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788197658.740321:0:14368:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cb9dfa30-4633-465a-85d4-89e35609b060->MGS 00000020:01000004:3.0:1788197658.740338:0:14368:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788197658.740343:0:14368:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788197658.740355:0:14368:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93c73c2f99b8) 00000020:00000080:3.0:1788197658.740366:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788197658.747902:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776327168 00000100:00100000:1.0:1788197658.747916:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776327168 00000100:00100000:1.0:1788197658.747955:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197658.747963:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c721ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875060776327168:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788197658.747988:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cb9dfa30-4633-465a-85d4-89e35609b060@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:1.0:1788197658.748013:0:14378:0:(genops.c:1385:class_connect()) connect: client cb9dfa30-4633-465a-85d4-89e35609b060, cookie 0x167e6c2924031006 00000100:00080000:1.0:1788197658.748132:0:14378:0:(import.c:65:import_set_state_nolock()) ffff93c737282000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197658.748223:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c721ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+5:3310:x1875060776327168:12345-0@lo:250:mount.lustre.0 Request processed in 259us (7958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197658.748231:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788197658.748897:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788197658.748907:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.140@tcp: connect to target with instance 0 00000100:00080000:0.0:1788197658.748914:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788197658.748918:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788197658.748922:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c6054e9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788197658.748925:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788197658.748939:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788197658.748947:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb9dfa30-4633-465a-85d4-89e35609b060:3310:1875060776327168:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788197658.756301:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197658.756570:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788197658.756577:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788197658.760277:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788197658.760290:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788197658.760717:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788197658.760724:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788197658.761786:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788197658.762122:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788197658.762128:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788197658.762591:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788197658.762598:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788197658.789558:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197658.793100:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788197658.793115:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788197658.795778:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788197658.795791:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788197658.796690:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197658.797030:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788197658.797035:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788197658.797456:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788197658.797463:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788197658.798153:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197658.798314:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788197658.798320:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788197658.798701:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788197658.798708:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788197658.799585:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788197658.800259:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788197658.800267:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788197658.800786:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788197658.800793:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788197658.827472:0:14368:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788197658.827665:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788197658.827673:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788197658.836291:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788197658.836369:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788197658.839138:0:14368:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788197658.839151:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788197658.844062:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788197658.844086:0:14368:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788197658.844093:0:14368:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788197658.844358:0:14368:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788197658.844635:0:14368:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788197658.844640:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788197658.844642:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788197658.844643:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197658.844644:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197658.844645:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197658.844647:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197658.844648:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788197658.844649:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788197658.844651:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197658.844652:0:14368:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788197658.844660:0:14368:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788197658.844662:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788197658.844663:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788197658.844664:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197658.844664:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197658.844665:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197658.844666:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197658.844667:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788197658.844668:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788197658.844669:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197658.844670:0:14368:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788197658.844695:0:14368:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788197658.844713:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788197658.844789:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197658.845079:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c74131cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788197658.845228:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776327296 00000100:00100000:3.0:1788197658.845236:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776327296 00000100:00100000:3.0:1788197658.845391:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197658.845408:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c704810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+5:14368:x1875060776327296:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788197658.845448:0:14380:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788197658.845451:0:14380:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788197658.845473:0:14380:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788197658.846082:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788197658.846439:0:14380:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788197658.849707:0:14403:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788197658.849715:0:14403:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788197658.849718:0:14403:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788197658.849749:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788197658.850020:0:14380:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788197658.850030:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788197658.861054:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c704810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+5:14368:x1875060776327296:12345-0@lo:253:mount.lustre.0 Request processed in 15644us (16255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197658.861074:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788197658.861082:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788197658.861101:0:14368:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788197658.861105:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788197658.861108:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788197658.861109:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788197658.861111:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788197658.861113:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788197658.861115:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788197658.861116:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788197658.861142:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788197658.861144:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788197658.861145:0:14368:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788197658.861165:0:14368:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c6054e9800 from lustre-MDT0000 10000000:01000000:1.0:1788197658.861191:0:14368:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788197658.861193:0:14368:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788197658.861197:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93c73c2fcd28 10000000:01000000:1.0:1788197658.861218:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788197658.861226:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93c73c2fcd28 from 1 10000000:01000000:1.0:1788197658.861228:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788197658.861274:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.861284:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.861293:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197658.861310:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788197658.861348:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197658.861386:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197658.861497:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776327424 00000100:00100000:3.0:1788197658.861504:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776327424 00000100:00100000:3.0:1788197658.861548:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788197658.861557:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c704812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+5:14368:x1875060776327424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197658.861568:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197658.861582:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7800/0x167e6c2924031014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403100d expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.861603:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7800/0x167e6c2924031014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403100d expref: 6 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.861613:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7800/0x167e6c2924031014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403100d expref: 6 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.861634:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7800, rc 0) 00000100:00100000:3.0:1788197658.861678:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c704812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+6:14368:x1875060776327424:12345-0@lo:101:mount.lustre.0 Request processed in 121us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197658.861685:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197658.861814:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788197658.861860:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.862050:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197658.862101:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788197658.862143:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197658.862166:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197658.862194:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776327552 00000100:00100000:2.0:1788197658.862200:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776327552 00000100:00100000:2.0:1788197658.862244:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788197658.862251:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+6:14368:x1875060776327552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197658.862442:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+6:14368:x1875060776327552:12345-0@lo:501:mount.lustre.0 Request processed in 190us (298us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788197658.862449:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197658.862539:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327552:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788197658.862563:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788197658.862579:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.862591:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197658.862598:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c6054e9800 10000000:01000000:1.0:1788197658.862602:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788197658.862607:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93c6054e9800 10000000:01000000:1.0:1788197658.862610:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788197658.862613:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93c6054e9800 from 1 10000000:01000000:1.0:1788197658.862616:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788197658.862634:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe600/0x167e6c292403101b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.862642:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c736abe600/0x167e6c292403101b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.862650:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c736abe600/0x167e6c292403101b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197658.862662:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788197658.862685:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197658.862751:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788197658.862786:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776327680 00000100:00100000:3.0:1788197658.862791:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776327680 00000100:00100000:3.0:1788197658.863116:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197658.863136:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+6:14368:x1875060776327680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197658.863146:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197658.863159:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7200/0x167e6c2924031022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403101b expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.863176:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7200/0x167e6c2924031022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403101b expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.863186:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7200/0x167e6c2924031022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403101b expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.863195:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7200, rc 0) 00000100:00100000:3.0:1788197658.863246:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+7:14368:x1875060776327680:12345-0@lo:101:mount.lustre.0 Request processed in 122us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197658.863261:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788197658.863325:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788197658.863344:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c736abe600/0x167e6c292403101b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031022 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.863352:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c736abe600/0x167e6c292403101b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924031022 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197658.863364:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788197658.863381:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe600/0x167e6c292403101b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031022 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.863388:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abe600/0x167e6c292403101b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031022 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197658.863394:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788197658.863397:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788197658.863401:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93c6054e9800 10000000:01000000:1.0:1788197658.863403:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788197658.863406:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788197658.863408:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788197658.863422:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe800/0x167e6c2924031029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.863428:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c736abe800/0x167e6c2924031029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.863435:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c736abe800/0x167e6c2924031029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197658.863448:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788197658.866585:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197658.866642:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197658.866710:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776327808 00000100:00100000:2.0:1788197658.866719:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776327808 00000100:00100000:2.0:1788197658.866767:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197658.866775:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+7:14368:x1875060776327808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788197658.866808:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197658.867571:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155d200/0x167e6c2924031030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031029 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197658.867604:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155d200/0x167e6c2924031030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031029 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197658.867616:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155d200/0x167e6c2924031030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031029 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197658.867624:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d200, rc 0) 00000100:00100000:2.0:1788197658.867679:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+8:14368:x1875060776327808:12345-0@lo:101:mount.lustre.0 Request processed in 904us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197658.867686:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788197658.868061:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788197658.868084:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c736abe800/0x167e6c2924031029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031030 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197658.868093:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c736abe800/0x167e6c2924031029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924031030 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197658.868177:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197658.868231:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197658.868672:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776327936 00000100:00100000:1.0:1788197658.868679:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776327936 00000100:00100000:1.0:1788197658.868724:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788197658.868733:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+8:14368:x1875060776327936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197658.869416:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197658.870715:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+9:14368:x1875060776327936:12345-0@lo:501:mount.lustre.0 Request processed in 1977us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197658.870727:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788197658.872120:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776327936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197658.872184:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788197658.872341:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197658.872420:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197658.872537:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776328064 00000100:00100000:2.0:1788197658.872544:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776328064 00000100:00100000:2.0:1788197658.872634:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788197658.872644:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+9:14368:x1875060776328064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197658.873222:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+9:14368:x1875060776328064:12345-0@lo:503:mount.lustre.0 Request processed in 577us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197658.873230:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788197658.873459:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788197658.874124:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14404:1875060776328192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197658.874174:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197658.874330:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788197658.874376:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776328192 00000100:00100000:1.0:1788197658.874382:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776328192 00000100:00100000:1.0:1788197658.874455:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788197658.874464:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+9:14404:x1875060776328192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788197658.874955:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+9:14404:x1875060776328192:12345-0@lo:502:llog_process_th.0 Request processed in 490us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197658.874963:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788197658.875060:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14404:1875060776328192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788197658.875090:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197658.875100:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.875103:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788197658.875108:0:14404:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788197658.875117:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788197658.875131:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93c73c2f8000) 00000020:00000080:3.0:1788197658.875149:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788197658.875157:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788197658.875238:0:14404:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788197658.875245:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292403103e 00000020:00000080:3.0:1788197658.875663:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788197658.875669:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197658.875732:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197658.875735:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788197658.875740:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197658.875745:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197658.875746:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788197658.875749:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788197658.875758:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93c73cff19b8) 00000020:00000080:2.0:1788197658.875769:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788197658.875782:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788197658.875784:0:14404:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788197658.875787:0:14404:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788197658.875794:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788197658.875882:0:14404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6054e9800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788197658.875895:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93c73cff4d28) 00000020:00000080:2.0:1788197658.875903:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788197658.875953:0:14404:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788197658.875958:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c2924031053 00000020:00000080:2.0:1788197658.876053:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788197658.876059:0:14404:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788197658.876064:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x167e6c292403105a 00080000:01000000:2.0:1788197658.876070:0:14404:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788197658.876073:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c2924031061 00010000:00010000:1.0:1788197658.944029:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788197658.944626:0:14404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788197658.944808:0:14404:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788197658.945779:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93c73cfb99b8) 00000020:00000080:1.0:1788197658.945796:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788197658.945907:0:14404:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788197658.945916:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c292403106f 00000020:00000080:0.0:1788197658.946512:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788197658.954997:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x167e6c2924031076 00000020:00000080:3.0:1788197658.955583:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788197658.955595:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197658.955601:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.955603:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788197658.955606:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197658.955612:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.955613:0:14404:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788197658.955617:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788197658.955652:0:14404:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788197658.955666:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197658.955669:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.955671:0:14404:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788197658.955673:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788197658.955675:0:14404:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788197658.955677:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788197658.955678:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788197658.955680:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788197658.955682:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.955684:0:14404:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788197658.955686:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788197658.955690:0:14404:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788197658.955693:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.955694:0:14404:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788197658.955698:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788197658.955710:0:14404:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000020:01000000:3.0:1788197658.955736:0:14404:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788197658.955739:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788197658.955763:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93c71f570000) 00000020:00000080:3.0:1788197658.955778:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788197658.955786:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788197658.955942:0:14404:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788197658.955948:0:14404:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788197658.955955:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c2924031084 00010000:00080000:3.0:1788197658.955994:0:14404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c737058800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:3.0:1788197658.956410:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788197658.957120:0:14404:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788197658.957169:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788197658.961441:0:14404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788197658.962229:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788197658.962387:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788197658.963127:0:14408:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788197658.963132:0:14408:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788197658.964014:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788197658.964025:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788197658.964067:0:14404:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788197658.964088:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c292403108b 00000100:00080000:3.0:1788197658.964098:0:14404:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788197658.964104:0:14404:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c737058800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197658.964136:0:14404:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c281880 x1875060776328320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788197658.964160:0:14404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788197658.964241:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197658.964245:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.964246:0:14404:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788197658.964249:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:1.0:1788197658.964347:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776328320:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788197658.964361:0:14404:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788197658.964369:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788197658.964372:0:14404:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788197658.964373:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788197658.964376:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.964377:0:14404:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788197658.964380:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788197658.964384:0:14404:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788197658.964387:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197658.964388:0:14404:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788197658.964390:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788197658.964394:0:14404:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.140@tcp to nid 0x20000c0a8ce8c (192.168.206.140@tcp) 00000400:00000100:1.0:1788197658.964395:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060776328320 offset 0 length 520: 4 00000020:01000000:3.0:1788197658.964411:0:14404:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788197658.964414:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788197658.964423:0:14404:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93c71f5719b8) 00000020:00000080:3.0:1788197658.964433:0:14404:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788197658.964437:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788197658.964639:0:14404:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788197658.964645:0:14404:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788197658.964651:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x167e6c2924031099 00010000:00080000:3.0:1788197658.964679:0:14404:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c706694000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:3.0:1788197658.964916:0:14404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788197658.965800:0:14404:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788197658.965841:0:14404:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788197658.967126:0:14404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788197658.967228:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788197658.973137:0:14404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788197658.973751:0:14410:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788197658.973756:0:14410:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788197658.977611:0:14404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788197658.977627:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788197658.978281:0:14404:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788197658.978303:0:14404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c29240310a0 00000100:00080000:0.0:1788197658.978313:0:14404:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788197658.978319:0:14404:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c706694000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:0.0:1788197658.978353:0:14404:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c736f48a80 x1875060776328448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788197658.978378:0:14404:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788197658.978497:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776328448:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788197658.978565:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060776328448 offset 0 length 520: 4 00000020:01000000:0.0:1788197658.978575:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197658.978734:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197658.978738:0:14404:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788197658.978752:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788197658.978757:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197658.978758:0:14404:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788197658.978766:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788197658.978768:0:14404:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788197658.978771:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197658.978773:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197658.978774:0:14404:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788197658.978776:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788197658.978778:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197658.978780:0:14404:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788197658.978783:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788197658.978812:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14404:1875060776328576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197658.978881:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197658.978912:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197658.978956:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776328576 00000100:00100000:2.0:1788197658.978964:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776328576 00000100:00100000:2.0:1788197658.979015:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788197658.979024:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+9:14404:x1875060776328576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197658.980122:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+9:14404:x1875060776328576:12345-0@lo:502:llog_process_th.0 Request processed in 1094us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197658.980133:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788197658.980247:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14404:1875060776328576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788197658.980281:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788197658.980287:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788197658.980289:0:14404:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788197658.980293:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788197658.980388:0:14368:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788197658.980411:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788197658.980433:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe800/0x167e6c2924031029 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031030 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.980444:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abe800/0x167e6c2924031029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031030 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197658.980452:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6054e9800 from 1 10000000:01000000:1.0:1788197658.980455:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788197658.980494:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.980502:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.980511:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197658.980527:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788197658.980557:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197658.980594:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788197658.980660:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776328704 00000100:00100000:3.0:1788197658.980665:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776328704 00000100:00100000:3.0:1788197658.980704:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788197658.980712:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+9:14368:x1875060776328704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197658.980743:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197658.980763:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240310a7 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.980787:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240310a7 expref: 10 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.980796:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240310a7 expref: 10 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.980805:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6000, rc 0) 00000100:00100000:3.0:1788197658.980857:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+10:14368:x1875060776328704:12345-0@lo:101:mount.lustre.0 Request processed in 146us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197658.980863:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788197658.981195:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788197658.981218:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197658.981228:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197658.981805:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328832:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788197658.981874:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197658.981910:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788197658.981948:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776328832 00000100:00100000:2.0:1788197658.981956:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776328832 00000100:00100000:2.0:1788197658.981999:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788197658.982007:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+10:14368:x1875060776328832:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788197658.982025:0:14379:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788197658.982041:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788197658.982114:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+10:14368:x1875060776328832:12345-0@lo:256:mount.lustre.0 Request processed in 108us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197658.982121:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788197658.982503:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328832:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788197658.984239:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788197658.984277:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197658.984289:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197658.984298:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6054e9800 from 1 10000000:01000000:0.0:1788197658.984301:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197658.984349:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197658.984358:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197658.984369:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197658.984391:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788197658.984448:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197658.984490:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7078e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788197658.984513:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776328960 00000100:00100000:1.0:1788197658.984522:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776328960 00000100:00100000:1.0:1788197658.984571:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788197658.984580:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+10:14368:x1875060776328960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788197658.984593:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197658.984607:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240310b5 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.984641:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240310b5 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.984650:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240310b5 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197658.984658:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe000, rc 0) 00000100:00100000:1.0:1788197658.984711:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+11:14368:x1875060776328960:12345-0@lo:101:mount.lustre.0 Request processed in 130us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197658.984718:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788197658.986730:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776328960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197658.986755:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197658.986768:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197658.986889:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197658.986947:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197658.986980:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c704cd5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788197658.987195:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329088 00000100:00100000:1.0:1788197658.987213:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329088 00000100:00100000:1.0:1788197658.987263:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788197658.987272:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+11:14368:x1875060776329088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788197658.987646:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+11:14368:x1875060776329088:12345-0@lo:501:mount.lustre.0 Request processed in 374us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197658.987655:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788197658.988289:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197658.988347:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788197658.988394:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197658.988435:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c704cd5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788197658.988697:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329216 00000100:00100000:1.0:1788197658.988704:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329216 00000100:00100000:1.0:1788197658.989194:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788197658.989217:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+11:14368:x1875060776329216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788197658.989643:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+11:14368:x1875060776329216:12345-0@lo:503:mount.lustre.0 Request processed in 438us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197658.989652:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788197658.990412:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197658.993556:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14413:1875060776329344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197658.993656:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197658.993702:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7057d3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197658.993742:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329344 00000100:00100000:0.0:1788197658.993757:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329344 00000100:00100000:0.0:1788197658.993805:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788197658.993815:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+11:14413:x1875060776329344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197658.994105:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+11:14413:x1875060776329344:12345-0@lo:502:llog_process_th.0 Request processed in 291us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197658.994113:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788197659.001462:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14413:1875060776329344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788197659.001518:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197659.001532:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197659.001534:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788197659.001540:0:14413:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6054e9800 00000020:00000080:2.0:1788197659.001543:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788197659.001552:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197659.001554:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197659.001556:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788197659.001558:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197659.001560:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197659.001561:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788197659.001565:0:14413:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c6054e9800 00000020:00000080:2.0:1788197659.001566:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788197659.001683:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197659.001688:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197659.001689:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788197659.001692:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197659.001694:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197659.001695:0:14413:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788197659.001699:0:14413:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c6054e9800 00000020:00000080:2.0:1788197659.001701:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788197659.006526:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14413:1875060776329472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197659.006602:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197659.006642:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329472 00000100:00100000:2.0:1788197659.006649:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329472 00000100:00100000:2.0:1788197659.006692:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197659.006701:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+11:14413:x1875060776329472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197659.007388:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+11:14413:x1875060776329472:12345-0@lo:502:llog_process_th.0 Request processed in 686us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197659.007397:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788197659.007451:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7057d3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197659.007471:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14413:1875060776329472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788197659.007500:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197659.007507:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197659.007510:0:14413:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788197659.007515:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788197659.007702:0:14368:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788197659.007724:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788197659.007781:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.007792:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197659.007947:0:14368:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788197659.007951:0:14368:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c6054e9800 10000000:01000000:1.0:1788197659.007954:0:14368:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c6054e9800 10000000:01000000:1.0:1788197659.007958:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788197659.007963:0:14368:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c6054e9800 from 1 10000000:01000000:1.0:1788197659.007965:0:14368:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788197659.007991:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf000/0x167e6c29240310c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.008000:0:14368:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c736abf000/0x167e6c29240310c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.008008:0:14368:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c736abf000/0x167e6c29240310c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197659.008024:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788197659.008164:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197659.008226:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197659.008345:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329600 00000100:00100000:2.0:1788197659.008351:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329600 00000100:00100000:2.0:1788197659.008379:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788197659.008385:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+11:14368:x1875060776329600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788197659.008395:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197659.008407:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155dc00/0x167e6c29240310ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240310c3 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.008426:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155dc00/0x167e6c29240310ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240310c3 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.008436:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155dc00/0x167e6c29240310ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240310c3 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.008445:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155dc00, rc 0) 00000100:00100000:2.0:1788197659.008477:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:14368:x1875060776329600:12345-0@lo:101:mount.lustre.0 Request processed in 91us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197659.008484:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788197659.008545:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788197659.008558:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c736abf000/0x167e6c29240310c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ca expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.008567:0:14368:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c736abf000/0x167e6c29240310c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240310ca expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197659.008620:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788197659.008644:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197659.008670:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197659.008712:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329728 00000100:00100000:2.0:1788197659.008721:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329728 00000100:00100000:2.0:1788197659.008742:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788197659.008749:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+12:14368:x1875060776329728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197659.009175:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+12:14368:x1875060776329728:12345-0@lo:501:mount.lustre.0 Request processed in 424us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197659.009183:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788197659.009338:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788197659.009370:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788197659.009406:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197659.009465:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197659.009497:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329856 00000100:00100000:2.0:1788197659.009502:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329856 00000100:00100000:2.0:1788197659.009525:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788197659.009532:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:14368:x1875060776329856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197659.009707:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:14368:x1875060776329856:12345-0@lo:503:mount.lustre.0 Request processed in 174us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197659.009713:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788197659.009767:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776329856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197659.011562:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14416:1875060776329984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197659.011634:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197659.011675:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7057d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197659.011690:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776329984 00000100:00100000:0.0:1788197659.011697:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776329984 00000100:00100000:0.0:1788197659.011739:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788197659.011747:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:14416:x1875060776329984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788197659.011994:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:14416:x1875060776329984:12345-0@lo:502:llog_process_th.0 Request processed in 247us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197659.012002:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788197659.012148:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14416:1875060776329984:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788197659.012220:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788197659.012234:0:14416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93c73cff3370) 00000020:00000080:2.0:1788197659.012960:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788197659.013115:0:14416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c6054e9800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788197659.013120:0:14416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c6054e9800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788197659.013123:0:14416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c6054e9800 4 00010000:00080000:2.0:1788197659.013158:0:14416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c717bdb000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.140@tcp at head 00010000:00010000:2.0:1788197659.018753:0:14416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788197659.024503:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788197659.024541:0:14416:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788197659.024559:0:14416:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x167e6c29240310d8 00000100:00080000:2.0:1788197659.024569:0:14416:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788197659.024576:0:14416:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93c717bdb000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1788197659.024607:0:14416:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c7417f9f80 x1875060776330112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788197659.024642:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776330112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788197659.024702:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197659.024745:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776330112 00000100:00080000:2.0:1788197659.024754:0:14416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788197659.024768:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776330112 00000100:00100000:1.0:1788197659.024807:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197659.024815:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875060776330112:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788197659.024905:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875060776330112:12345-0@lo:38:llog_process_th.0 Request processed in 89us (202us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788197659.024912:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197659.024950:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788197659.024959:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c717bdb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788197659.024963:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788197659.024966:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776330112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788197659.029165:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14416:1875060776330240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197659.029263:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197659.029303:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776330240 00000100:00100000:2.0:1788197659.029311:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776330240 00000100:00100000:2.0:1788197659.029352:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788197659.029362:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+12:14416:x1875060776330240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788197659.029586:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+12:14416:x1875060776330240:12345-0@lo:502:llog_process_th.0 Request processed in 225us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197659.029595:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788197659.029638:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7053bd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788197659.029658:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb9dfa30-4633-465a-85d4-89e35609b060:14416:1875060776330240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788197659.029685:0:14416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788197659.029941:0:14368:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788197659.029960:0:14368:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788197659.029983:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf000/0x167e6c29240310c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ca expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.030005:0:14368:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abf000/0x167e6c29240310c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ca expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788197659.030044:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788197659.030046:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788197659.030048:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788197659.030049:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788197659.030050:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788197659.030052:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788197659.030053:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788197659.030055:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788197659.030056:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788197659.030058:0:14368:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788197659.030061:0:14368:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788197659.030064:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788197659.030065:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788197659.030066:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788197659.030068:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788197659.030069:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788197659.030070:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788197659.030071:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788197659.030072:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788197659.030073:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788197659.030074:0:14368:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788197659.030089:0:14368:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788197659.030099:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776330368:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788197659.030147:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197659.030178:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73707ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197659.030237:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776330368 00000100:00100000:2.0:1788197659.030243:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776330368 00000100:00100000:2.0:1788197659.030305:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788197659.030313:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:14368:x1875060776330368:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788197659.030334:0:14379:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788197659.030347:0:14379:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788197659.075663:0:14379:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788197659.075715:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788197659.075805:0:14402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788197659.075810:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788197659.075857:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197659.075875:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240310a7 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197659.075884:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197659.075921:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c29240310a7 expref: 12 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197659.075936:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c29240310a7 expref: 12 pid: 14378 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197659.075952:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1875060776330496:0@lo:104: 00000100:00100000:0.0:1788197659.076112:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197659.076159:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c727268cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197659.076240:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776330496 00000100:00100000:2.0:1788197659.076248:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776330496 00000100:00100000:2.0:1788197659.076292:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788197659.076301:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb9dfa30-4633-465a-85d4-89e35609b060+3:14402:x1875060776330496:12345-0@lo:104: 00010000:00010000:2.0:1788197659.076312:0:14369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.076376:0:14369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197659.076382:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb9dfa30-4633-465a-85d4-89e35609b060+3:14402:x1875060776330496:12345-0@lo:104: Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197659.076388:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788197659.076407:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197659.076413:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.076420:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197659.076423:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.076431:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197659.076438:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197659.076444:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197659.076470:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.076492:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197659.076512:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.076519:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c736abe200/0x167e6c29240310a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310ae expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197659.076535:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197659.076537:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197659.076539:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197659.076568:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776330624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197659.076689:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1875060776330496:0@lo:104: 00010000:00010000:1.0:1788197659.076707:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197659.076766:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197659.076912:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776330624 00000100:00100000:1.0:1788197659.076921:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776330624 00010000:00010000:1.0:1788197659.076941:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240310a7 expref: 13 pid: 14378 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197659.076970:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197659.076977:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb9dfa30-4633-465a-85d4-89e35609b060+13:3313:x1875060776330624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197659.076996:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197659.077002:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240310a7 expref: 13 pid: 14378 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077012:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c29240310a7 expref: 13 pid: 14378 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077026:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6000/0x167e6c29240310ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c29240310a7 expref: 13 pid: 14378 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077039:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077047:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788197659.077060:0:14371:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001250758s 00010000:00010000:1.0:1788197659.077064:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077070:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077076:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077092:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077098:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742143200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197659.077102:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077110:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077123:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077132:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197659.077165:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb9dfa30-4633-465a-85d4-89e35609b060+12:3313:x1875060776330624:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197659.077172:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788197659.077193:0:14402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077200:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197659.077216:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742143200/0x167e6c29240310df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197659.077383:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776330624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788197659.084780:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+11:14368:x1875060776330368:12345-0@lo:253:mount.lustre.0 Request processed in 54458us (54623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197659.084796:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788197659.084975:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:14368:1875060776330368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788197659.085004:0:14368:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788197659.085008:0:14368:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788197659.085024:0:14368:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788197659.085026:0:14368:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788197659.085027:0:14368:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788197659.085028:0:14368:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788197659.085030:0:14368:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788197659.085031:0:14368:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788197659.085033:0:14368:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788197659.085035:0:14368:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788197659.085036:0:14368:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788197659.085052:0:14368:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788197659.089809:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197659.090083:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788197659.090399:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197659.090568:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788197659.091053:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197659.091337:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788197659.094520:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197659.094709:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788197659.095545:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788197659.095964:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788197659.096418:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788197659.096606:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788197659.123101:0:14368:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788197659.123675:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788197659.123732:0:14426:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788197659.123736:0:14426:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788197659.124572:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788197659.124710:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788197659.126303:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788197659.126437:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788197659.127269:0:14368:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788197659.127288:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788197659.128503:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788197659.128639:0:14427:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788197659.128645:0:14427:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788197659.129160:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197659.131442:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788197659.132235:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788197659.132350:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788197659.134498:0:14368:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788197659.141533:0:14368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788197659.206787:0:14368:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788197659.206843:0:14368:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f0101d9b988 00100000:10000000:1.0:1788197659.206852:0:14368:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788197659.208526:0:14368:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788197659.208542:0:14368:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788197659.208556:0:14368:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788197659.208575:0:14368:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788197659.761816:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788197660.079117:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788197660.147726:0:14382:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788197660.147734:0:14382:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6054e9800 from 6 10000000:01000000:2.0:1788197660.147739:0:14382:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788197660.147781:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.147793:0:14382:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.147804:0:14382:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197660.147857:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776330752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788197660.147918:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197660.147971:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70940fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197660.148120:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776330752 00000100:00100000:2.0:1788197660.148127:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776330752 00000100:00100000:2.0:1788197660.148172:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788197660.148180:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+11:14382:x1875060776330752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197660.148193:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197660.148216:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240310e6 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.148238:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240310e6 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.148248:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240310e6 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.148257:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d600, rc 0) 00000100:00100000:2.0:1788197660.148293:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776330752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197660.148300:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788197660.148340:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776330752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197660.148352:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.148361:0:14382:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197660.148412:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776330880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788197660.148441:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197660.148455:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70940fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197660.148468:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776330880 00000100:00100000:2.0:1788197660.148471:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776330880 00000100:00100000:2.0:1788197660.148495:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788197660.148501:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776330880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788197660.148513:0:14379:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788197660.148528:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788197660.148532:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788197660.148603:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776330880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197660.148610:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788197660.148640:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776330880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788197660.148677:0:14382:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788197660.148683:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.149500:0:14382:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197660.781974:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788197661.104650:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788197661.806526:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197662.832015:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788197663.515654:0:14669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788197663.881878:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788197664.113860:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197664.113867:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788197664.113870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197664.113873:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788197664.113876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788197664.113879:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788197664.113882:0:36:0:(import.c:65:import_set_state_nolock()) ffff93c717bdb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788197664.113893:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93c717bdb000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197664.113911:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c281f80 x1875060776331136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788197664.118702:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776331008:0@lo:400:kworker.0 00000100:00100000:3.0:1788197664.118788:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197664.118845:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776331136:0@lo:38:kworker.0 00000100:00100000:2.0:1788197664.118880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197664.118930:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776331136 00000100:00100000:3.0:1788197664.118937:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776331136 00000100:00100000:0.0:1788197664.118973:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776331008 00000100:00100000:0.0:1788197664.118977:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776331008 00000100:00100000:3.0:1788197664.119058:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197664.119066:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875060776331136:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788197664.119090:0:14388:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1788197664.119128:0:14388:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x167e6c29240310f4 00000004:00100000:3.0:1788197664.119148:0:14388:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788197664.119292:0:14388:0:(import.c:65:import_set_state_nolock()) ffff93c706697000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197664.119343:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875060776331136:12345-0@lo:38:kworker.0 Request processed in 275us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197664.119352:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788197664.119523:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c73c281f80 x1875060776331136/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788197674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788197664.119539:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788197664.119546:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788197664.119551:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788197664.119554:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c717bdb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788197664.119561:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875060776331136:0@lo:38:kworker.0 00000100:00100000:0.0:1788197664.119852:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788197664.119863:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:3314:x1875060776331008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197664.119912:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:3314:x1875060776331008:12345-0@lo:400:kworker.0 Request processed in 53us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197664.119919:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788197664.120001:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776331008:0@lo:400:kworker.0 00010000:00010000:3.0:1788197664.891761:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197665.902068:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788197666.479248:0:14821:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff32fdafa0 20000000:00000080:2.0:1788197666.479268:0:14821:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c70fc2f400 uarg=0000000000000000 20000000:01000000:2.0:1788197666.479308:0:14821:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788197666.479316:0:14821:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788197666.479320:0:14821:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788197666.481935:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788197666.482266:0:14821:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788197666.496412:0:14821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788197666.496442:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.496475:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240310b5 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.496483:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.496526:0:14821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c29240310b5 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.496542:0:14821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c29240310b5 expref: 11 pid: 14380 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197666.496556:0:14821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f49f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875060776331264:0@lo:104: 00000100:00100000:0.0:1788197666.496633:0:14821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197666.496747:0:14821:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056ec000 going to sleep for 11 seconds 00000100:00100000:1.0:1788197666.497792:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776331264 00000100:00100000:1.0:1788197666.497802:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776331264 00000100:00100000:1.0:1788197666.498436:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788197666.498448:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+3:14821:x1875060776331264:12345-0@lo:104: 00010000:00010000:1.0:1788197666.498463:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197666.498558:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788197666.498575:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+3:14821:x1875060776331264:12345-0@lo:104: Request processed in 130us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197666.498582:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197666.498651:0:14821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f49f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875060776331264:0@lo:104: 00010000:00010000:2.0:1788197666.498673:0:14821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.498730:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197666.498737:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.498744:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742143600 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197666.498748:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.498757:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197666.498763:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197666.498790:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788197666.498853:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.498860:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197666.498882:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.498889:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742143600/0x167e6c29240310b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310bc expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.498906:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197666.498908:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197666.498910:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197666.499432:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776331392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197666.499479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197666.499635:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776331392 00000100:00100000:0.0:1788197666.499642:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776331392 00010000:00010000:0.0:1788197666.499666:0:14371:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240310b5 expref: 12 pid: 14380 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197666.499729:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197666.499737:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb9dfa30-4633-465a-85d4-89e35609b060+12:3311:x1875060776331392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788197666.499748:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197666.499754:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240310b5 expref: 12 pid: 14380 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499777:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c29240310b5 expref: 12 pid: 14380 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499804:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c736abe000/0x167e6c29240310bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c29240310b5 expref: 12 pid: 14380 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499818:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499852:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499866:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499874:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499880:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499886:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499892:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742142600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197666.499895:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499902:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499919:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197666.499939:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197666.500061:0:14821:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.500069:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197666.500075:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142600/0x167e6c29240310fb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197666.501125:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb9dfa30-4633-465a-85d4-89e35609b060+11:3311:x1875060776331392:12345-0@lo:103:ldlm_bl.0 Request processed in 1372us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197666.501135:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788197666.503389:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776331392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788197666.926936:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197667.950186:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197668.209455:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788197658/real 1788197658] req@ffff93c736f48a80 x1875060776328448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197668 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197668.209486:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c736f48a80 x1875060776328448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197668 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197668.209498:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788197658/real 1788197658] req@ffff93c73c281880 x1875060776328320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197668 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197668.209509:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c73c281880 x1875060776328320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197668 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788197668.209528:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788197668.209552:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788197668.209557:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776328448:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788197668.209562:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c737058800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788197668.209568:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788197668.209570:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776328320:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788197668.209770:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197668.209775:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788197668.209777:0:37:0:(import.c:65:import_set_state_nolock()) ffff93c737058800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788197668.209782:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1788197668.209786:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788197668.209805:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c737058800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197668.209814:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197668.209851:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776331520:0@lo:400:kworker.0 00000100:00100000:3.0:1788197668.209912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197668.209970:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776331520 00000100:00100000:3.0:1788197668.209977:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776331520 00000100:00100000:3.0:1788197668.210016:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788197668.210024:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+11:3311:x1875060776331520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197668.210070:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+11:3311:x1875060776331520:12345-0@lo:400:kworker.0 Request processed in 46us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197668.210077:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788197668.210116:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776331520:0@lo:400:kworker.0 00000100:00100000:3.0:1788197668.210146:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c281f80 x1875060776331648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788197668.210173:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197668.210176:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788197668.210178:0:37:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788197668.210182:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:3.0:1788197668.210184:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788197668.210188:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c706694000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197668.210199:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c283b80 x1875060776331776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788197668.210228:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776331904:0@lo:400:kworker.0 00000100:00100000:3.0:1788197668.210257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197668.214081:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776331904 00000100:00100000:2.0:1788197668.214106:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776331904 00000100:00100000:2.0:1788197668.214189:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788197668.214199:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776331904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197668.214293:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776331904:12345-0@lo:400:kworker.0 Request processed in 96us (4035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197668.214300:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788197668.214339:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776331648:0@lo:8:kworker.0 00000400:00000100:2.0:1788197668.214369:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060776331648 offset 0 length 520: 4 00000100:00100000:2.0:1788197668.214394:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776331776:0@lo:8:kworker.0 00000400:00000100:2.0:1788197668.214413:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875060776331776 offset 0 length 520: 4 00010000:00080000:1.0:1788197668.214542:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c73c282680 x1875060776331904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197668.214557:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776331904:0@lo:400:kworker.0 10000000:01000000:2.0:1788197668.525946:0:14382:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788197668.525954:0:14382:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6054e9800 from 10 10000000:01000000:2.0:1788197668.525959:0:14382:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788197668.525999:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197668.526010:0:14382:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197668.526020:0:14382:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197668.526042:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776332032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788197668.526101:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197668.526177:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788197668.526289:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332032 00000100:00100000:0.0:1788197668.526297:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332032 00000100:00100000:0.0:1788197668.526345:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788197668.526354:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+11:14382:x1875060776332032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788197668.526374:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197668.526388:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031102 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197668.526409:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031102 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197668.526418:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031102 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197668.526427:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142800, rc 0) 00000100:00100000:0.0:1788197668.526471:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776332032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197668.526478:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788197668.528851:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776332032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197668.528888:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197668.528915:0:14382:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197668.528987:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776332160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197668.529040:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197668.529080:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788197668.529530:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332160 00000100:00100000:0.0:1788197668.529537:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332160 00000100:00100000:0.0:1788197668.529587:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788197668.529597:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776332160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197668.529912:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776332160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197668.529921:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788197668.533856:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776332160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197668.533939:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776332288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197668.534011:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197668.534046:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706655900 going to sleep for 11 seconds 00000100:00100000:0.0:1788197668.535045:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332288 00000100:00100000:0.0:1788197668.535057:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332288 00000100:00100000:0.0:1788197668.535112:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788197668.535121:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776332288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197668.535354:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+12:14382:x1875060776332288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197668.535374:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788197668.535432:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776332288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788197668.536197:0:14901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788197668.536254:0:14382:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788197668.536280:0:14382:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788197668.536291:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197668.536302:0:14382:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197668.974400:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197669.998915:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197671.025408:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788197671.344474:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788197671.537937:0:15069:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788197671.537942:0:15069:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788197671.538115:0:15069:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c7049bd000 00000020:01000004:2.0:1788197671.538131:0:15069:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788197671.538152:0:15069:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788197671.538164:0:15069:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93c73cff0000) 00000020:00000080:2.0:1788197671.538177:0:15069:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788197671.581236:0:15069:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788197671.581499:0:15069:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788197671.588517:0:15069:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788197671.589241:0:15069:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788197671.589477:0:15069:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788197671.589857:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 331: rc = 0 00100000:10000000:1.0:1788197671.589958:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 331: rc = 0 00100000:10000000:1.0:1788197671.590050:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 331: rc = 0 00100000:10000000:1.0:1788197671.590473:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 845: rc = 0 00100000:10000000:1.0:1788197671.590802:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 845: rc = 0 00100000:10000000:1.0:1788197671.591068:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 845: rc = 0 00100000:10000000:1.0:1788197671.592040:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 845: rc = 0 00100000:10000000:1.0:1788197671.592746:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 845: rc = 0 00100000:10000000:1.0:1788197671.593735:0:15069:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 845: rc = 0 00000020:00000080:1.0:1788197671.595381:0:15069:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788197671.595399:0:15069:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788197671.595411:0:15069:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x167e6c2924031117 00000020:01000004:1.0:1788197671.595419:0:15069:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788197671.595438:0:15069:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788197671.595440:0:15069:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788197671.595445:0:15069:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788197671.595450:0:15069:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788197671.595461:0:15069:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93c73cfbb370) 00000020:00000080:1.0:1788197671.595469:0:15069:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788197671.598970:0:15069:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788197671.599194:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788197671.599201:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788197671.601633:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788197671.601647:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788197671.602714:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788197671.602724:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788197671.605201:0:15069:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788197671.605374:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788197671.605380:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788197671.607296:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788197671.607306:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788197671.643195:0:15069:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197671.643435:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788197671.643442:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788197671.646729:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788197671.646742:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788197671.648458:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788197671.648470:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788197671.656713:0:15069:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788197671.656916:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788197671.656922:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788197671.657743:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788197671.657753:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788197671.729510:0:15069:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788197671.730095:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788197671.730102:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788197671.738424:0:15069:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788197671.738437:0:15069:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788197671.739720:0:15069:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788197671.739756:0:15069:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788197671.739762:0:15069:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788197671.753643:0:15069:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788197671.753690:0:15069:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.140@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788197671.753695:0:15069:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788197671.753697:0:15069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788197671.753698:0:15069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197671.753700:0:15069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197671.753701:0:15069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197671.753703:0:15069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197671.753704:0:15069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197671.753706:0:15069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197671.753712:0:15069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788197671.753715:0:15069:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788197671.753717:0:15069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788197671.753718:0:15069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788197671.753719:0:15069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197671.753719:0:15069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197671.753720:0:15069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197671.753721:0:15069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197671.753722:0:15069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197671.753723:0:15069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197671.753723:0:15069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788197671.753747:0:15069:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788197671.753767:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788197671.753865:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197671.753926:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70539ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197671.754062:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332416 00000100:00100000:2.0:1788197671.754075:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332416 00000100:00100000:2.0:1788197671.754124:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788197671.754133:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:15069:x1875060776332416:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788197671.754171:0:14379:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788197671.754174:0:14379:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788197671.754179:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788197671.765196:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:15069:x1875060776332416:12345-0@lo:253:mount.lustre.0 Request processed in 11055us (11322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197671.765215:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788197671.765387:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788197671.765402:0:15069:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788197671.765405:0:15069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788197671.765407:0:15069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788197671.765408:0:15069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197671.765422:0:15069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788197671.765423:0:15069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197671.765424:0:15069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197671.765426:0:15069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788197671.765428:0:15069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197671.765429:0:15069:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788197671.765460:0:15069:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c7049bd000 from lustre-OST0000 10000000:01000000:3.0:1788197671.765485:0:15069:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788197671.765488:0:15069:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788197671.765494:0:15069:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c73c2fcd28 local copy 00010000:00010000:3.0:1788197671.765503:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197671.765700:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197671.765734:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.765770:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191000 going to sleep for 11 seconds 00000100:00100000:2.0:1788197671.765900:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332544 00000100:00100000:2.0:1788197671.765908:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332544 00000100:00100000:2.0:1788197671.765957:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788197671.765966:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:15069:x1875060776332544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197671.766120:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+12:15069:x1875060776332544:12345-0@lo:501:mount.lustre.0 Request processed in 154us (384us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788197671.766127:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788197671.767635:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332544:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788197671.767658:0:15069:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788197671.767940:0:15069:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788197671.767951:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.767961:0:15069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197671.767990:0:15069:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c7049bd000 10000000:01000000:3.0:1788197671.767995:0:15069:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788197671.768001:0:15069:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93c73c2fcd28 10000000:01000000:3.0:1788197671.768004:0:15069:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788197671.768007:0:15069:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93c73c2fcd28 from 1 10000000:01000000:3.0:1788197671.768010:0:15069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788197671.768050:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c2924031125 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.768059:0:15069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c2924031125 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.768070:0:15069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c2924031125 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197671.768089:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788197671.768152:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.768189:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191000 going to sleep for 11 seconds 00000100:00100000:0.0:1788197671.768194:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332672 00000100:00100000:0.0:1788197671.768201:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332672 00000100:00100000:0.0:1788197671.768254:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788197671.768263:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+12:15069:x1875060776332672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788197671.768275:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197671.768288:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142400/0x167e6c292403112c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031125 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197671.768311:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142400/0x167e6c292403112c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031125 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197671.768322:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142400/0x167e6c292403112c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031125 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197671.768344:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142400, rc 0) 00000100:00100000:1.0:1788197671.768458:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+13:15069:x1875060776332672:12345-0@lo:101:mount.lustre.0 Request processed in 195us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197671.768466:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788197671.768666:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197671.768680:0:15069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c2924031125 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403112c expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.768689:0:15069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c2924031125 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403112c expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197671.768703:0:15069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788197671.768721:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c2924031125 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403112c expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.768728:0:15069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6a00/0x167e6c2924031125 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403112c expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197671.768733:0:15069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788197671.768737:0:15069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788197671.768742:0:15069:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788197671.768750:0:15069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788197671.768765:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c2924031133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.768773:0:15069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c2924031133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.768780:0:15069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c2924031133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197671.768793:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788197671.768818:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.768873:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191000 going to sleep for 11 seconds 00000100:00100000:0.0:1788197671.768929:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332800 00000100:00100000:0.0:1788197671.768934:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332800 00000100:00100000:0.0:1788197671.769065:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788197671.769074:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+13:15069:x1875060776332800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788197671.769081:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197671.769091:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143400/0x167e6c292403113a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031133 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197671.769105:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143400/0x167e6c292403113a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031133 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197671.769112:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143400/0x167e6c292403113a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031133 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197671.769119:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143400, rc 0) 00000100:00100000:0.0:1788197671.769168:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776332800:12345-0@lo:101:mount.lustre.0 Request processed in 96us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197671.769175:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788197671.769246:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197671.769257:0:15069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c2924031133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403113a expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.769264:0:15069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c2924031133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403113a expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788197671.769930:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788197671.770980:0:15069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788197671.774312:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788197671.774399:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788197671.774431:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788197671.774477:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788197671.774510:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788197671.774618:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788197671.774689:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788197671.774698:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788197671.775155:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197671.775279:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.775367:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:0.0:1788197671.775450:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776332928 00000100:00100000:0.0:1788197671.775457:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776332928 00000100:00100000:0.0:1788197671.775504:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788197671.778326:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776332928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197671.783284:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776332928:12345-0@lo:501:mount.lustre.0 Request processed in 7764us (7996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197671.783298:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788197671.783655:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776332928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197671.783711:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788197671.783765:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.783794:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:1.0:1788197671.784644:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333056 00000100:00100000:1.0:1788197671.784653:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333056 00000100:00100000:1.0:1788197671.784711:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788197671.784720:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776333056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788197671.785701:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776333056:12345-0@lo:503:mount.lustre.0 Request processed in 973us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197671.785710:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788197671.786009:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788197671.786886:0:15069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788197671.786972:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197671.787103:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.787134:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:0.0:1788197671.787228:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333184 00000100:00100000:0.0:1788197671.787235:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333184 00000100:00100000:0.0:1788197671.787277:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788197671.787285:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776333184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788197671.787499:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776333184:12345-0@lo:502:mount.lustre.0 Request processed in 214us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197671.787507:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788197671.787791:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788197671.788079:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788197671.788132:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788197671.788179:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788197671.788344:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788197671.788386:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788197671.788422:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788197671.788475:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788197671.788605:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788197671.788643:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788197671.788692:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788197671.788730:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788197671.788778:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788197671.788815:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197671.788898:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.789010:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:2.0:1788197671.790681:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333312 00000100:00100000:2.0:1788197671.790692:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333312 00000100:00100000:2.0:1788197671.790843:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788197671.790854:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776333312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788197671.791101:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776333312:12345-0@lo:502:mount.lustre.0 Request processed in 248us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197671.791108:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788197671.794069:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788197671.794240:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788197671.794261:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788197671.798710:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788197671.798721:0:15083:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788197671.798727:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197671.798730:0:15083:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788197671.799703:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788197671.799719:0:15083:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93c71f574d28) 00000020:00000080:3.0:1788197671.799752:0:15083:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788197671.799766:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788197671.799853:0:15083:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c7049bd000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788197671.799860:0:15083:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788197671.799866:0:15083:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x167e6c2924031148 00010000:00010000:3.0:1788197671.804331:0:15083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788197671.804703:0:15083:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788197671.806782:0:15083:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788197671.808445:0:15083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788197671.808456:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197671.808462:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197671.808464:0:15083:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788197671.808467:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788197671.808470:0:15083:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788197671.808472:0:15083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788197671.808473:0:15083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788197671.808475:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788197671.808477:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197671.808479:0:15083:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788197671.808481:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197671.808484:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197671.808485:0:15083:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788197671.808496:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788197671.808499:0:15083:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788197671.808501:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197671.808503:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197671.808504:0:15083:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788197671.808506:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197671.808509:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197671.810919:0:15083:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788197671.811154:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788197671.811231:0:15083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197671.811236:0:15083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197671.811238:0:15083:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788197671.811241:0:15083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788197671.811447:0:15069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788197671.811473:0:15069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788197671.811494:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c2924031133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403113a expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.811505:0:15069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7000/0x167e6c2924031133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403113a expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197671.811522:0:15069:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c7049bd000 from 1 10000000:01000000:3.0:1788197671.811525:0:15069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788197671.811560:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.811567:0:15069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.811579:0:15069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197671.811601:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788197671.811661:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197671.820921:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333440 00000100:00100000:1.0:1788197671.820938:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333440 00000100:00100000:1.0:1788197671.821005:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788197671.821016:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+14:15069:x1875060776333440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788197671.821047:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197671.821064:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403114f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197671.821090:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403114f expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197671.821102:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403114f expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197671.821111:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfe00, rc 0) 00000100:00100000:1.0:1788197671.821177:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333440:12345-0@lo:101:mount.lustre.0 Request processed in 163us (9516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197671.821183:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788197671.822110:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c704a40180 going to sleep for 11 seconds 00000100:00100000:2.0:1788197671.822149:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788197671.822168:0:15069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.822178:0:15069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197671.827261:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788197671.827687:0:15069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788197671.828745:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788197671.828818:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788197671.829373:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788197671.829382:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788197671.829464:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197671.830648:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197671.830758:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197671.832340:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333568 00000100:00100000:0.0:1788197671.832351:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333568 00000100:00100000:0.0:1788197671.832432:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788197671.832442:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197671.832718:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333568:12345-0@lo:501:mount.lustre.0 Request processed in 277us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197671.832726:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788197671.832922:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197671.832965:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197671.833220:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197671.833243:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197671.833343:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333696 00000100:00100000:3.0:1788197671.833349:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333696 00000100:00100000:3.0:1788197671.833391:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788197671.833399:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788197671.833556:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333696:12345-0@lo:503:mount.lustre.0 Request processed in 157us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197671.833563:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788197671.833673:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788197671.834181:0:15069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788197671.834257:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788197671.834298:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197671.834326:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197671.834551:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333824 00000100:00100000:3.0:1788197671.834558:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333824 00000100:00100000:3.0:1788197671.834581:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788197671.834587:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197671.834763:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333824:12345-0@lo:502:mount.lustre.0 Request processed in 174us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197671.834770:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788197671.835018:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788197671.835402:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788197671.835454:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788197671.835507:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788197671.835573:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788197671.835607:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788197671.835655:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788197671.835692:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788197671.835729:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788197671.835963:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788197671.836179:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197671.836291:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197671.836377:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776333952 00000100:00100000:3.0:1788197671.836384:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776333952 00000100:00100000:3.0:1788197671.836419:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788197671.836426:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197671.836616:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776333952:12345-0@lo:502:mount.lustre.0 Request processed in 189us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197671.836624:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788197671.836873:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776333952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788197671.837054:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788197671.837065:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788197671.838497:0:15087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197671.838507:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197671.838509:0:15087:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788197671.838669:0:15087:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c7049bd000 00000020:00000080:2.0:1788197671.838672:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788197671.838679:0:15087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197671.838682:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197671.838684:0:15087:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788197671.838687:0:15087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197671.838689:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197671.838691:0:15087:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788197671.838695:0:15087:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c7049bd000 00000020:00000080:2.0:1788197671.838696:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788197671.839332:0:15087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197671.839337:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197671.839339:0:15087:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788197671.839342:0:15087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197671.839344:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197671.839346:0:15087:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788197671.839349:0:15087:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c7049bd000 00000020:00000080:2.0:1788197671.839352:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788197671.839633:0:15087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197671.839638:0:15087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197671.839639:0:15087:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788197671.839643:0:15087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788197671.843609:0:15069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788197671.843650:0:15069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788197671.843710:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.843723:0:15069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197671.848123:0:15069:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788197671.848127:0:15069:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c7049bd000 10000000:01000000:3.0:1788197671.848131:0:15069:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c7049bd000 10000000:01000000:3.0:1788197671.848134:0:15069:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788197671.848151:0:15069:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c7049bd000 from 1 10000000:01000000:3.0:1788197671.848154:0:15069:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788197671.848189:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292403115d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.848199:0:15069:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292403115d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.848815:0:15069:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292403115d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197671.848858:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788197671.848921:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.848965:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334080 00000100:00100000:3.0:1788197671.848971:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334080 00000100:00100000:3.0:1788197671.849080:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788197671.849090:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776334080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197671.849102:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197671.849114:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7e00/0x167e6c2924031164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c292403115d expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.849148:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7e00/0x167e6c2924031164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c292403115d expref: 16 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.849170:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7e00/0x167e6c2924031164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403115d expref: 16 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.849178:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7e00, rc 0) 00000100:00100000:3.0:1788197671.850075:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334080:12345-0@lo:101:mount.lustre.0 Request processed in 982us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197671.850084:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788197671.850153:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c704a40180 going to sleep for 11 seconds 00000100:00100000:3.0:1788197671.850177:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788197671.850193:0:15069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292403115d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031164 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.850202:0:15069:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292403115d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924031164 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788197671.858676:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788197671.859455:0:15069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788197671.859810:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788197671.859966:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788197671.860006:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788197671.860055:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788197671.860101:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788197671.860245:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788197671.860286:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788197671.860321:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788197671.860373:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788197671.860411:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788197671.860445:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788197671.860521:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788197671.860558:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788197671.860593:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788197671.860641:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788197671.860680:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788197671.860717:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788197671.860785:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788197671.861011:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788197671.861063:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788197671.861128:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788197671.861370:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788197671.861415:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788197671.861473:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788197671.861585:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788197671.861622:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788197671.861684:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788197671.861724:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788197671.861812:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788197671.861841:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788197671.861938:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197671.861996:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.862038:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:1.0:1788197671.863087:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334208 00000100:00100000:1.0:1788197671.863098:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334208 00000100:00100000:1.0:1788197671.863159:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788197671.863169:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788197671.863522:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334208:12345-0@lo:501:mount.lustre.0 Request processed in 344us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197671.863530:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788197671.864182:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197671.864304:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788197671.864357:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.864391:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:1.0:1788197671.865312:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334336 00000100:00100000:1.0:1788197671.865322:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334336 00000100:00100000:1.0:1788197671.865378:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788197671.865387:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788197671.865599:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334336:12345-0@lo:503:mount.lustre.0 Request processed in 211us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197671.865616:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788197671.866391:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334336:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788197671.869561:0:15069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788197671.869649:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197671.869735:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.869997:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:1.0:1788197671.876713:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334464 00000100:00100000:1.0:1788197671.876727:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334464 00000100:00100000:1.0:1788197671.876775:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788197671.876786:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788197671.877745:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334464:12345-0@lo:502:mount.lustre.0 Request processed in 955us (8005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197671.877755:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788197671.877879:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788197671.878200:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788197671.878279:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788197671.878319:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788197671.878370:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788197671.878409:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788197671.878457:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788197671.878493:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788197671.878525:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788197671.878809:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788197671.878866:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788197671.878954:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788197671.879284:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788197671.879320:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788197671.879347:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788197671.879402:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788197671.879433:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788197671.879464:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788197671.879636:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788197671.879670:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788197671.879697:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788197671.879734:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788197671.879763:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788197671.881739:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788197671.881843:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788197671.882132:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788197671.882184:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788197671.882234:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788197671.882265:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788197671.882308:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788197671.882363:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788197671.882406:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788197671.882440:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788197671.882474:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788197671.883677:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788197671.883745:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788197671.883799:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788197671.883858:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788197671.884130:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788197671.884198:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788197671.884234:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788197671.884280:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197671.884354:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197671.884528:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c737191900 going to sleep for 11 seconds 00000100:00100000:2.0:1788197671.889933:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334592 00000100:00100000:2.0:1788197671.889948:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334592 00000100:00100000:2.0:1788197671.890016:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788197671.890027:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788197671.890305:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334592:12345-0@lo:502:mount.lustre.0 Request processed in 279us (5949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197671.890313:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788197671.890383:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788197671.890491:0:15069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788197671.890507:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788197671.896501:0:15092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788197671.897275:0:15092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93c71f573370) 00000020:00000080:3.0:1788197671.897300:0:15092:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788197671.897401:0:15092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c7049bd000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788197671.897406:0:15092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c7049bd000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788197671.897408:0:15092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c7049bd000 3 00010000:00080000:3.0:1788197671.897440:0:15092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c73f143000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.140@tcp at head 00010000:00010000:3.0:1788197671.901808:0:15092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788197671.902258:0:15092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788197671.902295:0:15092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788197671.902319:0:15092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x167e6c2924031172 00000100:00080000:3.0:1788197671.902329:0:15092:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788197671.902335:0:15092:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93c73f143000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197671.902368:0:15092:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c282d80 x1875060776334720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788197671.902403:0:15092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788197671.902736:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788197671.902741:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788197671.902743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788197671.902746:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788197671.903170:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875060776334720:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788197671.903231:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197671.903284:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334720 00000100:00100000:2.0:1788197671.903290:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334720 00000100:00100000:2.0:1788197671.903318:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788197671.903324:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875060776334720:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788197671.903345:0:14386:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1788197671.903373:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x167e6c2924031179 00000004:00100000:2.0:1788197671.903386:0:14386:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788197671.903411:0:14386:0:(import.c:65:import_set_state_nolock()) ffff93c6057c1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788197671.903455:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875060776334720:12345-0@lo:38:llog_process_th.0 Request processed in 129us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197671.903462:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788197671.903638:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197671.903648:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776334848:0@lo:400:kworker.0 00000100:00100000:0.0:1788197671.903680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197671.903715:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334848 00000100:00100000:0.0:1788197671.903720:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334848 00000100:00100000:0.0:1788197671.903745:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197671.903751:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776334848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197671.903916:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776334848:12345-0@lo:400:kworker.0 Request processed in 165us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197671.903924:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788197671.903956:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c7417fce00 x1875060776334848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197671.903969:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776334848:0@lo:400:kworker.0 00010000:00080000:2.0:1788197671.905608:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93c73c282d80 x1875060776334720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788197681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197671.905622:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788197671.905629:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788197671.905637:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788197671.905642:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788197671.905651:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c73f143000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788197671.905658:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875060776334720:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788197671.906156:0:15092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788197671.906248:0:15069:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788197671.906274:0:15069:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788197671.906289:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292403115d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031164 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.906299:0:15069:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d7c00/0x167e6c292403115d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031164 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788197671.906350:0:15069:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788197671.906353:0:15069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788197671.906354:0:15069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197671.906355:0:15069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197671.906357:0:15069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197671.906358:0:15069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197671.906359:0:15069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788197671.906361:0:15069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197671.906363:0:15069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788197671.906367:0:15069:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788197671.906369:0:15069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788197671.906370:0:15069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788197671.906372:0:15069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197671.906373:0:15069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197671.906374:0:15069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197671.906375:0:15069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197671.906376:0:15069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788197671.906377:0:15069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197671.906378:0:15069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788197671.906399:0:15069:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788197671.906415:0:15069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334976:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788197671.906485:0:15069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197671.906520:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776334976 00000100:00100000:2.0:1788197671.906530:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776334976 00000100:00100000:2.0:1788197671.906580:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788197671.906587:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+16:15069:x1875060776334976:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788197671.906610:0:14380:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788197671.906623:0:14380:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788197671.907215:0:15069:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c540 going to sleep for 11 seconds 20000000:01000000:2.0:1788197671.935593:0:14380:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788197671.935648:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788197671.935865:0:14402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788197671.935870:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788197671.935892:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197671.935911:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240310e6 expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197671.935930:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197671.935972:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c29240310e6 expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197671.935996:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c29240310e6 expref: 16 pid: 14380 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197671.936026:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417ff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1875060776335104:0@lo:104: 00000100:00100000:1.0:1788197671.936091:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197671.936134:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7083566c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197671.936262:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776335104 00000100:00100000:2.0:1788197671.936270:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776335104 00000100:00100000:2.0:1788197671.936317:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788197671.936325:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb9dfa30-4633-465a-85d4-89e35609b060+3:14402:x1875060776335104:12345-0@lo:104: 00010000:00010000:2.0:1788197671.936336:0:14369:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936393:0:14369:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197671.936400:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb9dfa30-4633-465a-85d4-89e35609b060+3:14402:x1875060776335104:12345-0@lo:104: Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197671.936406:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788197671.936426:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197671.936432:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936439:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197671.936443:0:14375:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936452:0:14375:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197671.936470:0:14375:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197671.936476:0:14375:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197671.936501:0:14375:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936508:0:14375:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197671.936538:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936545:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c74155d800/0x167e6c29240310e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c29240310ed expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936563:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197671.936565:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197671.936566:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197671.936587:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776335232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788197671.936617:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197671.936657:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776335232 00000100:00100000:2.0:1788197671.936662:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776335232 00010000:00010000:2.0:1788197671.936679:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240310e6 expref: 17 pid: 14380 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197671.936699:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788197671.936704:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+17:3311:x1875060776335232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788197671.936714:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197671.936719:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c29240310e6 expref: 17 pid: 14380 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936735:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c29240310e6 expref: 17 pid: 14380 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936751:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936758:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788197671.936770:0:14373:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001250758s 00010000:00010000:2.0:1788197671.936774:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936780:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936785:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936791:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936795:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197671.936799:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936805:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936813:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197671.936864:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197671.936892:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+17:3311:x1875060776335232:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197671.936898:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788197671.936931:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776335232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788197671.937130:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c74155d600/0x167e6c29240310ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c29240310e6 expref: 16 pid: 14380 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197671.937150:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417ff100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1875060776335104:0@lo:104: 00010000:00010000:3.0:1788197671.937165:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.937173:0:14402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.937179:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197671.937184:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c736abf200/0x167e6c2924031180 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197671.946861:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+15:15069:x1875060776334976:12345-0@lo:253:mount.lustre.0 Request processed in 40266us (40367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197671.946874:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788197671.947102:0:15069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15069:1875060776334976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788197671.947117:0:15069:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788197671.947120:0:15069:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788197671.947122:0:15069:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788197671.947123:0:15069:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788197671.947124:0:15069:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788197671.947125:0:15069:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788197671.947126:0:15069:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788197671.947128:0:15069:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788197671.947129:0:15069:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788197671.947131:0:15069:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788197671.947156:0:15069:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788197671.951723:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197671.952357:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788197671.952603:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197671.952764:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788197671.953088:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197671.953298:0:15069:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788197671.954297:0:15069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788197672.022684:0:15069:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788197672.022693:0:15069:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788197672.022732:0:15069:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788197672.022794:0:15069:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788197672.022812:0:15069:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788197672.022858:0:15069:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788197672.050844:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197673.071779:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788197673.390254:0:14382:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788197673.390261:0:14382:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6054e9800 from 7 10000000:01000000:3.0:1788197673.390266:0:14382:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788197673.390417:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197673.390428:0:14382:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197673.390440:0:14382:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197673.390464:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776335360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788197673.390554:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197673.390678:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2db540 going to sleep for 11 seconds 00000100:00100000:1.0:1788197673.396350:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776335360 00000100:00100000:1.0:1788197673.396368:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776335360 00000100:00100000:1.0:1788197673.396473:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788197673.396485:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+15:14382:x1875060776335360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788197673.396502:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197673.396522:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031187 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197673.396551:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031187 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197673.396563:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031187 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197673.396573:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf600, rc 0) 00000100:00100000:1.0:1788197673.396654:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:14382:x1875060776335360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (6099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197673.396687:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788197673.396793:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776335360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197673.396812:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197673.396838:0:14382:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197673.396898:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776335488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788197673.396945:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197673.397419:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2db540 going to sleep for 11 seconds 00000100:00100000:2.0:1788197673.397557:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776335488 00000100:00100000:2.0:1788197673.397564:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776335488 00000100:00100000:2.0:1788197673.397596:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788197673.397604:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:14382:x1875060776335488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788197673.397621:0:14379:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788197673.397639:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788197673.397643:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788197673.398144:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:14382:x1875060776335488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 528us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197673.398152:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788197673.398259:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776335488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788197673.398337:0:14382:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788197673.398347:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197673.398356:0:14382:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197674.093998:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197675.118144:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197676.143402:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788197676.910028:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197676.910034:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788197676.910036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197676.910039:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788197676.910072:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197676.910097:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776335616:0@lo:400:kworker.0 00000100:00100000:3.0:1788197676.910173:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197676.910224:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776335744:0@lo:400:kworker.0 00000100:00100000:3.0:1788197676.910250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197676.910271:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788197676.910276:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776335872:0@lo:400:kworker.0 00000100:00100000:3.0:1788197676.910300:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197676.910330:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776335616 00000100:00100000:3.0:1788197676.910336:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776335616 00000100:00100000:3.0:1788197676.910374:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788197676.910382:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:3311:x1875060776335616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197676.910425:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:3311:x1875060776335616:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197676.910432:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788197676.910464:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776335744 00000100:00100000:3.0:1788197676.910467:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776335744 00000100:00100000:3.0:1788197676.910489:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776335872 00000100:00100000:3.0:1788197676.910491:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776335872 00000100:00100000:3.0:1788197676.910524:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788197676.910530:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776335744:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788197676.910532:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197676.910564:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776335744:12345-0@lo:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197676.910571:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788197676.910724:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197676.910734:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776335872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197676.910762:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776335872:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197676.910778:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788197676.910819:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c280a80 x1875060776335872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197676.910856:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776335872:0@lo:400:kworker.0 00010000:00080000:3.0:1788197676.910868:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c280e00 x1875060776335744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197676.910876:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776335744:0@lo:400:kworker.0 00000100:00100000:3.0:1788197676.910902:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776335616:0@lo:400:kworker.0 00010000:00010000:2.0:1788197677.168077:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788197677.819677:0:15437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788197678.191217:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197679.214091:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197680.240141:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197681.262435:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788197681.584572:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788197682.033113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788197682.033119:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788197682.033122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788197682.033125:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788197682.033172:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776336128:0@lo:400:kworker.0 00000100:00100000:2.0:1788197682.033238:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197682.033293:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788197682.033299:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb9dfa30-4633-465a-85d4-89e35609b060:3312:1875060776336000:0@lo:400:kworker.0 00000100:00100000:2.0:1788197682.033328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197682.033360:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776336256:0@lo:400:kworker.0 00000100:00100000:2.0:1788197682.033382:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197682.033414:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336128 00000100:00100000:2.0:1788197682.033421:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336128 00000100:00100000:2.0:1788197682.033456:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336256 00000100:00100000:2.0:1788197682.033459:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336256 00000100:00100000:2.0:1788197682.033483:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788197682.033490:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776336128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197682.033535:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776336128:12345-0@lo:400:kworker.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197682.033553:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788197682.033569:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197682.033576:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776336256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197682.033606:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776336256:12345-0@lo:400:kworker.0 Request processed in 32us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197682.033629:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197682.033650:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336000 00000100:00100000:2.0:1788197682.033654:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336000 00000100:00100000:2.0:1788197682.033675:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788197682.033680:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:3312:x1875060776336000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197682.033708:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:3312:x1875060776336000:12345-0@lo:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197682.033714:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788197682.033741:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788197682.033766:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c7417f9880 x1875060776336256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197682.033778:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776336256:0@lo:400:kworker.0 00000100:00100000:2.0:1788197682.033800:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb9dfa30-4633-465a-85d4-89e35609b060:3312:1875060776336000:0@lo:400:kworker.0 00010000:00080000:2.0:1788197682.033808:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c7417f8700 x1875060776336128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197682.033816:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776336128:0@lo:400:kworker.0 00010000:00010000:0.0:1788197682.286052:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197683.184165:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788197668/real 1788197668] req@ffff93c73c281f80 x1875060776331648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197683 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197683.184197:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c73c281f80 x1875060776331648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197683 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197683.184208:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788197668/real 1788197668] req@ffff93c73c283b80 x1875060776331776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197683 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197683.184219:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93c73c283b80 x1875060776331776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788197683 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788197683.184256:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c737058800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788197683.184284:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788197683.184288:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776331648:0@lo:8:kworker.0 00000100:00080000:2.0:1788197683.184294:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788197683.184299:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788197683.184303:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776331776:0@lo:8:kworker.0 00000100:00080000:3.0:1788197683.184456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197683.184460:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788197683.184462:0:37:0:(import.c:65:import_set_state_nolock()) ffff93c737058800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788197683.184467:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1788197683.184472:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788197683.184478:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93c737058800 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197683.184499:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c280e00 x1875060776336512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788197683.184511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197683.184514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788197683.184515:0:37:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788197683.184518:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1788197683.184521:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788197683.184524:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c706694000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197683.184534:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c280a80 x1875060776336640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788197683.184605:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776336768:0@lo:400:kworker.0 00000100:00100000:3.0:1788197683.184670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197683.184742:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197683.184748:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776336896:0@lo:400:kworker.0 00000100:00100000:3.0:1788197683.184771:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197683.185111:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197683.185122:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776336384:0@lo:400:kworker.0 00000100:00100000:0.0:1788197683.185156:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197683.185357:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336384 00000100:00100000:2.0:1788197683.185363:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336768 00000100:00100000:3.0:1788197683.185366:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336384 00000100:00100000:2.0:1788197683.185366:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336768 00000100:00100000:2.0:1788197683.185402:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336896 00000100:00100000:2.0:1788197683.185405:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336896 00000100:00100000:3.0:1788197683.185416:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788197683.185420:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788197683.185424:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+16:3313:x1875060776336384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197683.185426:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776336768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197683.185476:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+16:3313:x1875060776336384:12345-0@lo:400:kworker.0 Request processed in 52us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197683.185476:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776336768:12345-0@lo:400:kworker.0 Request processed in 49us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197683.185484:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788197683.185497:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788197683.185502:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788197683.185507:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776336896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197683.185534:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776336896:12345-0@lo:400:kworker.0 Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197683.185538:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776336384:0@lo:400:kworker.0 00000100:00100000:2.0:1788197683.185540:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788197683.185573:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776336512:0@lo:8:kworker.0 00010000:00080000:3.0:1788197683.185581:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c282300 x1875060776336896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197683.185591:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776336896:0@lo:400:kworker.0 00010000:00080000:3.0:1788197683.185601:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c281c00 x1875060776336768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197683.185602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197683.185609:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776336768:0@lo:400:kworker.0 00000100:00100000:2.0:1788197683.185616:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776336640:0@lo:8:kworker.0 00000100:00100000:2.0:1788197683.185637:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197683.185688:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336512 00000100:00100000:0.0:1788197683.185693:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336512 00000100:00100000:0.0:1788197683.185717:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776336640 00000100:00100000:0.0:1788197683.185720:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776336640 00000100:00100000:0.0:1788197683.185730:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788197683.185735:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875060776336512:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788197683.185757:0:15071:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788197683.185782:0:15071:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c2924031195 00002000:00100000:0.0:1788197683.185796:0:15071:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93c706bce800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788197683.185800:0:15071:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788197683.185809:0:15071:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788197683.186172:0:15071:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788197683.186197:0:15071:0:(import.c:65:import_set_state_nolock()) ffff93c706bca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788197683.186266:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875060776336512:12345-0@lo:8:kworker.0 Request processed in 528us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197683.186274:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788197683.186289:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197683.186293:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875060776336640:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788197683.186304:0:15071:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788197683.186329:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875060776336640:12345-0@lo:8:kworker.0 Request processed in 34us (691us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788197683.186334:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788197683.186465:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c280e00 x1875060776336512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788197703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788197683.186474:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788197683.186479:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788197683.186486:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788197683.186490:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788197683.186493:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c737058800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788197683.186516:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788197683.186521:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776336512:0@lo:8:kworker.0 00000100:00080000:2.0:1788197683.186531:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788197683.186535:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788197683.186538:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776336640:0@lo:8:kworker.0 00000004:00080000:3.0:1788197683.186768:0:14409:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788197683.186786:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1875060776337152:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788197683.186858:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197683.186875:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197683.186972:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337152 00000100:00100000:2.0:1788197683.186976:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337152 00000100:00100000:1.0:1788197683.186997:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776337024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197683.187010:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788197683.187016:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14409:x1875060776337152:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788197683.187028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788197683.187064:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197683.189353:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337024 00000100:00100000:3.0:1788197683.189363:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337024 00000100:00100000:3.0:1788197683.189415:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788197683.189423:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776337024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197683.189452:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197683.189525:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776337024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197683.189531:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788197683.190439:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c281c00 x1875060776337024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197683.190460:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776337024:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788197683.191310:0:14408:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788197683.191599:0:14408:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479337775363ns, next at 0ns, rc = 0 00002000:00080000:2.0:1788197683.200276:0:15073:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788197683.200289:0:15073:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788197683.200296:0:15073:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788197683.215174:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.215187:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.218889:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.218896:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.218905:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.218944:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.218955:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.218964:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.218986:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788197683.219364:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197683.219372:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.219380:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197683.219385:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.219394:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.219412:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.219420:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000707a912f/0x167e6c292403119c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.219447:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197683.219449:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197683.219451:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.220158:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.220167:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.220177:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.220181:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.220187:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.220197:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.220514:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.220538:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.220596:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197683.221293:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.221300:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.221310:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.221315:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.221319:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.221329:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.221336:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.221342:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.225972:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788197683.225984:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.225999:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197683.226004:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226015:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226037:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226044:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da5d30f9/0x167e6c29240311a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226064:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197683.226067:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226073:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155de00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197683.226097:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226105:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226116:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.226124:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197683.226126:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197683.226128:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.226198:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.226213:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197683.226754:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.226761:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226772:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.226776:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.226782:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226792:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226800:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226806:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226853:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197683.226878:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197683.226883:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226889:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.226893:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226906:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226918:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226925:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.226939:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.226940:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.226942:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.227347:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.227353:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227362:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.227365:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.227369:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227378:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227385:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227398:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227411:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197683.227420:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197683.227423:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227429:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.227432:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227438:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227448:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227455:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227466:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.227468:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.227469:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.227884:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.227898:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227907:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.227910:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.227914:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227926:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227934:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227940:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227955:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197683.227964:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197683.227967:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227974:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.227977:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.227985:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.228003:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.228010:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.228023:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.228025:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.228026:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.228428:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.228434:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.228443:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.228446:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.229378:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229400:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229409:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229417:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229444:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197683.229455:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197683.229461:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229467:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.229471:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229479:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229492:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229499:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.229516:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.229517:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.229519:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.232769:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.232783:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.232799:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788197683.233042:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.233097:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.233106:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.233121:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.233130:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.233137:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.233162:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788197683.234343:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197683.234352:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.234362:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ce00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197683.234366:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.234374:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.234391:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.234398:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c29240311cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.234425:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197683.234427:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197683.234428:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.235799:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.237078:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.237107:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.237112:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.237118:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.237133:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.237144:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.237160:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.237183:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788197683.237313:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.237321:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.237330:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.237335:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.237345:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.237364:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.237372:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c29240311d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.237393:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.237395:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.237404:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.238779:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.238788:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.238798:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.238801:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.238806:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239158:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239168:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239175:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239198:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197683.239620:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.239627:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239643:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.239646:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.239650:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239660:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239668:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239675:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239690:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788197683.239703:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788197683.239708:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239716:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.239721:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239729:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239756:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239764:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c29240311db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239782:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197683.239785:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239792:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155de00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.239795:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239801:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239860:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239877:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c29240311e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.239890:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.239892:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.239900:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.240350:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.240760:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.240768:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.240778:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.240781:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.240786:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.240796:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.240804:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.240812:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.240880:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197683.241406:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.241414:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241423:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.241427:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.241431:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241454:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241463:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241470:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241487:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788197683.241500:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788197683.241505:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241512:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.241517:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241527:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241540:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241547:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c29240311e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241568:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197683.241572:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241579:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.241582:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241590:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241600:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241607:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c29240311f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.241618:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.241620:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.241621:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.242191:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.242199:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.242319:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.242359:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.242369:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.242374:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.242385:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.242393:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.242400:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.242730:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197683.244775:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.247757:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.247776:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.247780:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.247786:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.247801:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.247812:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.247847:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250605:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197683.250617:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250628:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.250633:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250643:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250660:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250667:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c29240311f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250684:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.250687:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250693:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.250696:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250714:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250724:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.250730:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.250732:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.250734:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788197683.252280:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788197683.253404:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.253415:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017e04655/0x167e6c29240311fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197683.254053:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.254062:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.254075:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.254079:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.254096:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.254110:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.254119:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.254126:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.260414:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.260427:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.260440:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155de00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.260445:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.260456:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.260475:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.260483:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.260485:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.260487:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.261994:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.262009:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000189730ed/0x167e6c2924031205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197683.262725:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.262733:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.262747:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.262751:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.262757:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.262769:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.262778:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.262785:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.262800:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788197683.262986:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.262994:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.263001:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.263006:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.263014:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.263030:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.263036:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5b3c076/0x167e6c292403120c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.263051:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.263052:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.263054:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.263061:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.265478:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.265489:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.265512:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.265516:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.265522:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.265535:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.265545:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.265552:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.265613:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197683.266057:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.266063:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.266071:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.266074:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.266079:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.266099:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.266118:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.266125:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.266993:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197683.267003:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267013:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.267017:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267037:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267055:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267061:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a23719/0x167e6c2924031213 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267078:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.267081:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267098:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.267101:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267109:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267119:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267127:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.267128:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.267135:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.267219:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.267225:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084c2e285/0x167e6c292403121a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197683.267744:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.267751:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.267761:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.267765:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.267770:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.267781:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.267790:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.267911:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.267979:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.268023:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197683.268411:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.268418:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.268427:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.268431:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.268435:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.268446:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.268454:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.268461:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268543:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197683.268549:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268557:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.268571:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268580:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268593:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268600:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3d6df80/0x167e6c2924031221 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268615:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.268619:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268625:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.268628:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268648:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268658:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.268666:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.268668:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.268670:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.268792:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.268798:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013e61c50/0x167e6c2924031228 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197683.269363:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.269370:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.269379:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.269383:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.269387:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.269397:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.269405:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.269413:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.269482:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.269487:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.269495:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.269498:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.269506:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.269518:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.269526:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.269528:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.269530:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.269651:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.269657:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000594a615/0x167e6c292403122f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.271380:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197683.272444:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.272455:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.272481:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.272485:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.272491:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.272504:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.272515:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.272523:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.272586:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197683.273077:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.273096:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.273104:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.273108:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.273112:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.273120:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.273140:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.273147:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273396:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197683.273404:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273412:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.273417:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273425:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273442:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273450:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041d61e59/0x167e6c2924031236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273467:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.273471:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273477:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.273480:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273487:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273503:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.273511:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.273512:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.273515:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.273578:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.273584:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f559b926/0x167e6c292403123d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197683.274145:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197683.274152:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.274161:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788197683.274165:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197683.274170:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.274179:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.274188:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.274206:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.274357:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197683.274363:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.274371:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ce00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.274375:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.274383:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.274395:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.274404:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.274405:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197683.274407:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.274493:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197683.274499:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e11f6ec8/0x167e6c2924031244 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.275129:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788197683.275478:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788197683.275486:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.275496:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788197683.275500:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197683.275505:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.275516:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.275524:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.275532:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.275593:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788197683.276050:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788197683.276057:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.276075:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1788197683.276078:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197683.276093:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.276104:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.276112:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197683.276119:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.276498:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197683.276505:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.276519:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abec00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197683.276523:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.276531:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.276545:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197683.276553:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9a4d2a1/0x167e6c292403124b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.276625:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197683.276630:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.276637:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfc00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197683.276640:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.276647:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.276658:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197683.276666:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.276667:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197683.276670:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197683.276783:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788197683.276788:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf8976d/0x167e6c2924031252 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788197683.277054:0:15073:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788197683.277159:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14409:x1875060776337152:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90138us (90296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197683.277172:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788197683.277353:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197683.277387:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1875060776337152:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788197683.277400:0:14409:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788197683.277437:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1875060776337280:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788197683.277467:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197683.277510:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73c2dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197683.277556:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337280 00000100:00100000:1.0:1788197683.277615:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337280 00000100:00100000:1.0:1788197683.277686:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197683.277696:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1875060776337280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788197683.277735:0:15071:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788197683.283310:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14409:x1875060776337280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5608us (5834us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788197683.283322:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197683.283450:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c282300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14409:1875060776337280:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788197683.283465:0:14409:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788197683.310032:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197684.334861:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788197684.341879:0:15788:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788197684.341883:0:15788:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788197684.341984:0:15788:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93c604cfe000 00000020:01000004:1.0:1788197684.341998:0:15788:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788197684.342011:0:15788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788197684.342026:0:15788:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93c73cfbcd28) 00000020:00000080:1.0:1788197684.342041:0:15788:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788197684.365130:0:15788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788197684.365410:0:15788:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788197684.366968:0:15788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788197684.367224:0:15788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788197684.369066:0:15788:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788197684.369449:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 647: rc = 0 00100000:10000000:2.0:1788197684.369769:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 647: rc = 0 00100000:10000000:2.0:1788197684.370095:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 647: rc = 0 00100000:10000000:2.0:1788197684.370801:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 862: rc = 0 00100000:10000000:2.0:1788197684.371106:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 862: rc = 0 00100000:10000000:2.0:1788197684.371749:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 862: rc = 0 00100000:10000000:3.0:1788197684.372545:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 862: rc = 0 00100000:10000000:3.0:1788197684.372799:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 862: rc = 0 00100000:10000000:3.0:1788197684.373213:0:15788:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 862: rc = 0 00000020:00000080:3.0:1788197684.374214:0:15788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788197684.374224:0:15788:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788197684.374233:0:15788:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x167e6c2924031260 00000020:01000004:3.0:1788197684.374240:0:15788:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788197684.374258:0:15788:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788197684.374261:0:15788:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788197684.374266:0:15788:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788197684.374283:0:15788:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788197684.374286:0:15788:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788197684.394645:0:15788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788197684.395128:0:15788:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.140@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788197684.395133:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788197684.395145:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788197684.395147:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197684.395149:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788197684.395150:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197684.395151:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197684.395153:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788197684.395155:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197684.395156:0:15788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788197684.395160:0:15788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788197684.395162:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788197684.395163:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788197684.395165:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788197684.395166:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788197684.395167:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788197684.395168:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788197684.395169:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788197684.395170:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788197684.395171:0:15788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788197684.395195:0:15788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788197684.395213:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337408:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788197684.395275:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.395348:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197684.395583:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337408 00000100:00100000:2.0:1788197684.395591:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337408 00000100:00100000:2.0:1788197684.395654:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788197684.395663:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:15788:x1875060776337408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788197684.395700:0:14379:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788197684.395704:0:14379:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788197684.395708:0:14379:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788197684.417165:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:15788:x1875060776337408:12345-0@lo:253:mount.lustre.0 Request processed in 21495us (21882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.417178:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788197684.417320:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788197684.417334:0:15788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788197684.417336:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788197684.417338:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788197684.417340:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788197684.417341:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788197684.417342:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788197684.417344:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788197684.417354:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788197684.417356:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788197684.417357:0:15788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788197684.417479:0:15788:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93c604cfe000 from lustre-OST0001 10000000:01000000:2.0:1788197684.417511:0:15788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788197684.417514:0:15788:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788197684.417520:0:15788:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93c73c2fcd28 local copy 00010000:00010000:2.0:1788197684.417530:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197684.417722:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197684.417983:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197684.418010:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706655300 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.418170:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337536 00000100:00100000:0.0:1788197684.418176:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337536 00000100:00100000:0.0:1788197684.418219:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788197684.418227:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:15788:x1875060776337536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197684.418587:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:15788:x1875060776337536:12345-0@lo:501:mount.lustre.0 Request processed in 359us (603us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788197684.418594:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788197684.418675:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337536:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788197684.418691:0:15788:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788197684.418886:0:15788:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788197684.418893:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197684.418902:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abf400/0x167e6c292403100d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031014 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788197684.418924:0:15788:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93c604cfe000 10000000:01000000:1.0:1788197684.418928:0:15788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788197684.418934:0:15788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788197684.418936:0:15788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788197684.418940:0:15788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788197684.418943:0:15788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788197684.418966:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe000/0x167e6c2924031267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197684.418983:0:15788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c736abe000/0x167e6c2924031267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197684.418992:0:15788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c736abe000/0x167e6c2924031267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197684.419006:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788197684.419034:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197684.419053:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056ec300 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.419331:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337664 00000100:00100000:0.0:1788197684.419336:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337664 00000100:00100000:0.0:1788197684.419504:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788197684.419511:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+16:15788:x1875060776337664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788197684.419521:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197684.419533:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143c00/0x167e6c292403126e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031267 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.419552:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143c00/0x167e6c292403126e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031267 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.419562:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143c00/0x167e6c292403126e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031267 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.419570:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143c00, rc 0) 00000100:00100000:0.0:1788197684.419610:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776337664:12345-0@lo:101:mount.lustre.0 Request processed in 98us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.419616:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788197684.419697:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788197684.419709:0:15788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c736abe000/0x167e6c2924031267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403126e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.419718:0:15788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c736abe000/0x167e6c2924031267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403126e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197684.422775:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788197684.426238:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788197684.428022:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788197684.428102:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788197684.428271:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788197684.428329:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788197684.428429:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788197684.428471:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788197684.428548:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788197684.428557:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788197684.428644:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197684.428704:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197684.428810:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.430457:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337792 00000100:00100000:0.0:1788197684.430470:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337792 00000100:00100000:2.0:1788197684.430627:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788197684.430637:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776337792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197684.431640:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776337792:12345-0@lo:501:mount.lustre.0 Request processed in 1001us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197684.431649:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788197684.431717:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788197684.431763:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788197684.431809:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197684.431986:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056ec300 going to sleep for 11 seconds 00000100:00100000:3.0:1788197684.432751:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776337920 00000100:00100000:3.0:1788197684.432760:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776337920 00000100:00100000:2.0:1788197684.433005:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788197684.433014:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776337920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197684.433513:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776337920:12345-0@lo:503:mount.lustre.0 Request processed in 498us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197684.433521:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788197684.433607:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776337920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788197684.434213:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788197684.434279:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788197684.434327:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197684.435285:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.435364:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338048 00000100:00100000:0.0:1788197684.435371:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338048 00000100:00100000:0.0:1788197684.435401:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788197684.435408:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776338048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788197684.435634:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776338048:12345-0@lo:502:mount.lustre.0 Request processed in 225us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.435642:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788197684.435787:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788197684.436039:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788197684.436103:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788197684.436151:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788197684.436198:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788197684.436233:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788197684.436265:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788197684.436355:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788197684.436394:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788197684.436453:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788197684.436486:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788197684.436532:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197684.436556:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7056ec300 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.437276:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338176 00000100:00100000:0.0:1788197684.437283:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338176 00000100:00100000:0.0:1788197684.437315:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788197684.437321:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776338176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788197684.437514:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776338176:12345-0@lo:502:mount.lustre.0 Request processed in 192us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.437522:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788197684.437676:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788197684.437777:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788197684.437789:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788197684.439425:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788197684.439433:0:15789:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788197684.439440:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788197684.439442:0:15789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788197684.439448:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788197684.439461:0:15789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93c73cfb8000) 00000020:00000080:1.0:1788197684.439497:0:15789:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788197684.439504:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788197684.439556:0:15789:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c604cfe000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788197684.439564:0:15789:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788197684.439571:0:15789:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x167e6c292403127c 00010000:00010000:2.0:1788197684.445546:0:15789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788197684.447292:0:15789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788197684.449659:0:15789:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788197684.451790:0:15789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788197684.451800:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197684.451806:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197684.451808:0:15789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788197684.451812:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197684.451815:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197684.451817:0:15789:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788197684.451841:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788197684.451844:0:15789:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788197684.451847:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197684.451849:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197684.451851:0:15789:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788197684.451853:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788197684.451855:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197684.451857:0:15789:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788197684.451870:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788197684.451933:0:15789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788197684.451937:0:15789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788197684.451938:0:15789:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788197684.451941:0:15789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788197684.452156:0:15788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788197684.452181:0:15788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788197684.452204:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abe000/0x167e6c2924031267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403126e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.452214:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abe000/0x167e6c2924031267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403126e expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788197684.452221:0:15788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c604cfe000 from 1 10000000:01000000:0.0:1788197684.452224:0:15788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788197684.452258:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.452265:0:15788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.452274:0:15788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197684.452293:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788197684.452362:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197684.452402:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c739fc7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197684.452554:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338304 00000100:00100000:2.0:1788197684.452562:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338304 00000100:00100000:2.0:1788197684.452608:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788197684.452618:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:15788:x1875060776338304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788197684.452629:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197684.452641:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031283 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.452661:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031283 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.452672:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031283 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.452680:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155c800, rc 0) 00000100:00100000:2.0:1788197684.452717:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338304:12345-0@lo:101:mount.lustre.0 Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197684.452723:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788197684.452882:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788197684.452897:0:15788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.452917:0:15788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788197684.454727:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788197684.455593:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197684.455842:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788197684.456614:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788197684.456709:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788197684.456718:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788197684.456794:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197684.457023:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197684.457115:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c739fc7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788197684.459621:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338432 00000100:00100000:3.0:1788197684.459632:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338432 00000100:00100000:3.0:1788197684.459689:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788197684.459698:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788197684.460000:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338432:12345-0@lo:501:mount.lustre.0 Request processed in 303us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197684.460007:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788197684.460267:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788197684.460312:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788197684.460421:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197684.460447:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338560 00000100:00100000:0.0:1788197684.460450:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338560 00000100:00100000:0.0:1788197684.460483:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788197684.460490:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788197684.460621:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338560:12345-0@lo:503:mount.lustre.0 Request processed in 131us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.460627:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788197684.460668:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c739fc7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.460682:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788197684.461462:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788197684.461534:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788197684.461579:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197684.461650:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c706205300 going to sleep for 11 seconds 00000100:00100000:1.0:1788197684.465290:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338688 00000100:00100000:1.0:1788197684.465301:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338688 00000100:00100000:1.0:1788197684.465355:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788197684.465364:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c721ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788197684.465597:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c721ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338688:12345-0@lo:502:mount.lustre.0 Request processed in 233us (4016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197684.465604:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788197684.465806:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788197684.466123:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788197684.466186:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788197684.466228:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788197684.466263:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788197684.466294:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788197684.466338:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788197684.466385:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788197684.466417:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788197684.466458:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197684.466507:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.466543:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788197684.466794:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338816 00000100:00100000:2.0:1788197684.466800:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338816 00000100:00100000:2.0:1788197684.466852:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788197684.466870:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c704810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788197684.467028:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c704810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338816:12345-0@lo:502:mount.lustre.0 Request processed in 168us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197684.467035:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788197684.467254:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788197684.467340:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788197684.467408:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788197684.468327:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197684.468339:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197684.468342:0:15793:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788197684.468424:0:15793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c604cfe000 00000020:00000080:3.0:1788197684.468433:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788197684.468441:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197684.468444:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197684.468446:0:15793:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788197684.468448:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197684.468451:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197684.468452:0:15793:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788197684.468456:0:15793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93c604cfe000 00000020:00000080:3.0:1788197684.468458:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788197684.471521:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197684.471537:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197684.471539:0:15793:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788197684.471543:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788197684.471548:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197684.471549:0:15793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788197684.471553:0:15793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93c604cfe000 00000020:00000080:3.0:1788197684.471556:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788197684.474319:0:15793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788197684.474330:0:15793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788197684.474333:0:15793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788197684.474337:0:15793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788197684.478558:0:15788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788197684.478599:0:15788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788197684.478658:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.478671:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197684.478715:0:15788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788197684.478718:0:15788:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93c604cfe000 10000000:01000000:2.0:1788197684.478720:0:15788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93c604cfe000 10000000:01000000:2.0:1788197684.478724:0:15788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788197684.478729:0:15788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93c604cfe000 from 1 10000000:01000000:2.0:1788197684.478732:0:15788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788197684.478767:0:15788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155c600/0x167e6c2924031291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.478775:0:15788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c74155c600/0x167e6c2924031291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.478785:0:15788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c74155c600/0x167e6c2924031291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197684.478807:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788197684.478906:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197684.478953:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.479978:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776338944 00000100:00100000:0.0:1788197684.479987:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776338944 00000100:00100000:0.0:1788197684.480034:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788197684.480044:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c704812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776338944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788197684.480058:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197684.480072:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143200/0x167e6c2924031298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031291 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.480109:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143200/0x167e6c2924031298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031291 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.480120:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143200/0x167e6c2924031298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031291 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.480129:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143200, rc 0) 00000100:00100000:0.0:1788197684.480189:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c704812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776338944:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.480196:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788197684.480327:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776338944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788197684.480343:0:15788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c74155c600/0x167e6c2924031291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031298 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.480427:0:15788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c74155c600/0x167e6c2924031291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c2924031298 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197684.483334:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788197684.486647:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788197684.488643:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788197684.488735:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788197684.488771:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788197684.488815:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788197684.490339:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788197684.490689:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788197684.490729:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788197684.490761:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788197684.490810:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788197684.492297:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788197684.492343:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788197684.492422:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788197684.492456:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788197684.492489:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788197684.492539:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788197684.492578:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788197684.492633:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788197684.492698:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788197684.492736:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788197684.492769:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788197684.492814:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788197684.492872:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788197684.492907:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788197684.492949:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788197684.492979:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788197684.493005:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788197684.493073:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788197684.493126:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788197684.494626:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788197684.494707:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788197684.494746:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788197684.494780:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788197684.495324:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788197684.496047:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788197684.496108:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788197684.496232:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788197684.496273:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788197684.496543:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788197684.496553:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788197684.496650:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197684.496709:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197684.497379:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197684.504269:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339072 00000100:00100000:1.0:1788197684.504281:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339072 00000100:00100000:1.0:1788197684.504340:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788197684.504360:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788197684.504651:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339072:12345-0@lo:501:mount.lustre.0 Request processed in 291us (7940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197684.504659:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788197684.508583:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788197684.508643:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197684.508710:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197684.508795:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7066a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197684.514874:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339200 00000100:00100000:1.0:1788197684.514887:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339200 00000100:00100000:2.0:1788197684.516609:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788197684.516623:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788197684.516888:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605435450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339200:12345-0@lo:503:mount.lustre.0 Request processed in 268us (8177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197684.516897:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788197684.517014:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788197684.517761:0:15788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788197684.517860:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197684.517911:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.517947:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788197684.518158:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339328 00000100:00100000:2.0:1788197684.518165:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339328 00000100:00100000:2.0:1788197684.518202:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788197684.518217:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788197684.518485:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339328:12345-0@lo:502:mount.lustre.0 Request processed in 268us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197684.518492:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788197684.518576:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788197684.518783:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788197684.518853:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788197684.518886:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788197684.518923:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788197684.518960:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788197684.518998:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788197684.519023:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788197684.519047:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788197684.519094:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788197684.519124:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788197684.519216:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788197684.519255:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788197684.519282:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788197684.519307:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788197684.519341:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788197684.519466:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788197684.519493:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788197684.519536:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788197684.519565:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788197684.519590:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788197684.519625:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788197684.519651:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788197684.519675:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788197684.519709:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788197684.519735:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788197684.519760:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788197684.519818:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788197684.520578:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788197684.520607:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788197684.520651:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788197684.520679:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788197684.520705:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788197684.520730:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788197684.520765:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788197684.520809:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788197684.521129:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788197684.521229:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788197684.521267:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788197684.521315:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788197684.521411:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788197684.521456:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788197684.521530:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.521568:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73709ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.521709:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339456 00000100:00100000:0.0:1788197684.521717:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339456 00000100:00100000:0.0:1788197684.521766:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788197684.521776:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788197684.522022:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605434850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776339456:12345-0@lo:502:mount.lustre.0 Request processed in 247us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.522030:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788197684.522156:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776339456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788197684.522237:0:15788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788197684.522247:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788197684.523455:0:15798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788197684.523477:0:15798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93c606b499b8) 00000020:00000080:3.0:1788197684.523496:0:15798:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788197684.523576:0:15798:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93c604cfe000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788197684.523580:0:15798:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93c604cfe000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788197684.523582:0:15798:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93c604cfe000 3 00010000:00080000:3.0:1788197684.523608:0:15798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93c741707000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.140@tcp at head 00010000:00010000:3.0:1788197684.527605:0:15798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788197684.527953:0:15798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788197684.527990:0:15798:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788197684.528007:0:15798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x167e6c29240312a6 00000100:00080000:3.0:1788197684.528017:0:15798:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788197684.528022:0:15798:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93c741707000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197684.528054:0:15798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c281500 x1875060776339584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788197684.528088:0:15798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788197684.528315:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875060776339584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788197684.528384:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.528573:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339584 00000100:00100000:3.0:1788197684.528580:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339584 00000100:00100000:3.0:1788197684.528615:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197684.528623:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875060776339584:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788197684.528642:0:14387:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1788197684.528671:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x167e6c29240312ad 00000004:00100000:3.0:1788197684.528695:0:14387:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788197684.528722:0:14387:0:(import.c:65:import_set_state_nolock()) ffff93c7105d1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197684.528771:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875060776339584:12345-0@lo:38:llog_process_th.0 Request processed in 148us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197684.528778:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788197684.528863:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c281500 x1875060776339584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788197694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788197684.528873:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788197684.528879:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788197684.528885:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788197684.528889:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788197684.528892:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c741707000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788197684.528897:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875060776339584:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788197684.529066:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788197684.529071:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788197684.529073:0:37:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788197684.529091:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:3.0:1788197684.529095:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788197684.529099:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c706694000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:3.0:1788197684.529114:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c73c283800 x1875060776339840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788197684.529167:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788197684.529176:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776339712:0@lo:400:kworker.0 00000100:00100000:3.0:1788197684.529206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.529234:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776339968:0@lo:400:kworker.0 00000100:00100000:3.0:1788197684.529253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.529268:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788197684.529273:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776340096:0@lo:400:kworker.0 00000100:00100000:3.0:1788197684.529306:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.529328:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339968 00000100:00100000:3.0:1788197684.529331:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339968 00000100:00100000:3.0:1788197684.529364:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340096 00000100:00100000:3.0:1788197684.529367:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340096 00000100:00100000:3.0:1788197684.529391:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788197684.529397:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776339968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197684.529437:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875060776339968:12345-0@lo:400:kworker.0 Request processed in 40us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197684.529444:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788197684.529462:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788197684.529468:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776340096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197684.529493:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875060776340096:12345-0@lo:400:kworker.0 Request processed in 25us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197684.529498:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788197684.529513:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788197684.529530:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c280380 x1875060776340096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197684.529540:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875060776340096:0@lo:400:kworker.0 00010000:00080000:3.0:1788197684.529549:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93c73c281500 x1875060776339968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788197684.529557:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875060776339968:0@lo:400:kworker.0 00000040:00080000:3.0:1788197684.529688:0:15798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1788197684.530007:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776339840:0@lo:8:kworker.0 00000100:00100000:0.0:1788197684.530040:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.530212:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339712 00000100:00100000:3.0:1788197684.530217:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339712 00000100:00100000:3.0:1788197684.530544:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776339840 00000100:00100000:3.0:1788197684.530548:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776339840 00000100:00100000:0.0:1788197684.530587:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788197684.530596:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776339712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197684.530647:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875060776339712:12345-0@lo:400:kworker.0 Request processed in 53us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.530653:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788197684.530668:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788197684.530672:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875060776339840:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788197684.530718:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875060776339840:12345-0@lo:8:kworker.0 Request processed in 43us (676us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788197684.530724:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788197684.530748:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788197684.530755:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788197684.530758:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788197684.530774:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776339840:0@lo:8:kworker.0 00000100:00100000:2.0:1788197684.530865:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776339712:0@lo:400:kworker.0 00000020:01000000:1.0:1788197684.533531:0:15788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788197684.533581:0:15788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788197684.533605:0:15788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c74155c600/0x167e6c2924031291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031298 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197684.533617:0:15788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c74155c600/0x167e6c2924031291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c2924031298 expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788197684.533670:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788197684.533672:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788197684.533674:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788197684.533675:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788197684.533676:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788197684.533678:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788197684.533679:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788197684.533681:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788197684.533683:0:15788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788197684.533686:0:15788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788197684.533689:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788197684.533690:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788197684.533692:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788197684.533693:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788197684.533699:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788197684.533700:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788197684.533701:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788197684.533702:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788197684.533702:0:15788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788197684.533731:0:15788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788197684.533749:0:15788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776340224:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788197684.533862:0:15788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197684.533903:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340224 00000100:00100000:1.0:1788197684.533910:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340224 00000100:00100000:1.0:1788197684.533947:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788197684.533955:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+19:15788:x1875060776340224:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788197684.533993:0:14380:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788197684.534006:0:14380:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788197684.534745:0:15788:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711854600 going to sleep for 11 seconds 20000000:01000000:2.0:1788197684.569701:0:14380:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788197684.569720:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788197684.569843:0:14402:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788197684.569847:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788197684.569866:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197684.569885:0:14402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031187 expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197684.569913:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197684.569952:0:14402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c2924031187 expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197684.569966:0:14402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c2924031187 expref: 19 pid: 14378 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197684.569980:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1875060776340352:0@lo:104: 00000100:00100000:3.0:1788197684.570044:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197684.570101:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c74131c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788197684.570236:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340352 00000100:00100000:0.0:1788197684.570244:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340352 00000100:00100000:0.0:1788197684.570284:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788197684.570294:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+3:14402:x1875060776340352:12345-0@lo:104: 00010000:00010000:0.0:1788197684.570305:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197684.570359:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788197684.570365:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+3:14402:x1875060776340352:12345-0@lo:104: Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197684.570372:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197684.570519:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14402:1875060776340352:0@lo:104: 00010000:00010000:3.0:1788197684.570538:0:14402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.570722:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197684.570728:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.570736:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:2.0:1788197684.570739:0:14374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.570748:0:14374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788197684.570756:0:14374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788197684.570762:0:14374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788197684.570792:0:14374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.570799:0:14374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788197684.570818:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.570841:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d6200/0x167e6c2924031187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292403118e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.570867:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197684.570869:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197684.570871:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197684.570898:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776340480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788197684.570930:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197684.570972:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340480 00000100:00100000:2.0:1788197684.570977:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340480 00010000:00010000:2.0:1788197684.570997:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924031187 expref: 20 pid: 14378 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197684.571020:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788197684.571026:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+20:3313:x1875060776340480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788197684.571037:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197684.571041:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924031187 expref: 20 pid: 14378 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571052:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c2924031187 expref: 20 pid: 14378 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571065:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c736abf600/0x167e6c292403118e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c2924031187 expref: 20 pid: 14378 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571090:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571098:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788197684.571109:0:14373:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001262879s 00010000:00010000:2.0:1788197684.571120:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571127:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571134:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571140:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571145:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197684.571149:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571156:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571169:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571178:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197684.571302:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+19:3313:x1875060776340480:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197684.571309:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788197684.571414:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776340480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788197684.571438:0:14402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571446:0:14402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197684.571459:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6000/0x167e6c29240312b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197684.578435:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605435c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+18:15788:x1875060776340224:12345-0@lo:253:mount.lustre.0 Request processed in 44471us (44607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197684.578449:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788197684.578595:0:15788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb9dfa30-4633-465a-85d4-89e35609b060:15788:1875060776340224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788197684.578610:0:15788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788197684.578614:0:15788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788197684.578615:0:15788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788197684.578617:0:15788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788197684.578618:0:15788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788197684.578619:0:15788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788197684.578620:0:15788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788197684.578621:0:15788:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788197684.578623:0:15788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788197684.578625:0:15788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788197684.578638:0:15788:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788197684.584089:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197684.584276:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788197684.584450:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197684.584601:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788197684.584753:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788197684.585140:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788197684.586309:0:15788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788197684.649520:0:15788:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788197684.649537:0:15788:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788197684.649574:0:15788:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788197684.649654:0:15788:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788197684.649668:0:15788:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788197684.649695:0:15788:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788197685.360094:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788197686.001120:0:14382:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788197686.001132:0:14382:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93c6054e9800 from 8 10000000:01000000:3.0:1788197686.001139:0:14382:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788197686.001201:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6800/0x167e6c29240312bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197686.001214:0:14382:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6800/0x167e6c29240312bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197686.001241:0:14382:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6800/0x167e6c29240312bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197686.001281:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776340608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788197686.001388:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197686.001457:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7012edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197686.002463:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340608 00000100:00100000:2.0:1788197686.002480:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340608 00000100:00100000:2.0:1788197686.002576:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788197686.002589:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+18:14382:x1875060776340608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197686.002609:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197686.002629:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c74155d800/0x167e6c29240312c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c29240312bb expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197686.002660:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c74155d800/0x167e6c29240312c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c29240312bb expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197686.002691:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c74155d800/0x167e6c29240312c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c29240312bb expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197686.002702:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c74155d800, rc 0) 00000100:00100000:2.0:1788197686.002775:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605434450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776340608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197686.002783:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788197686.003086:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776340608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197686.003109:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6800/0x167e6c29240312bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240312c2 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197686.003120:0:14382:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6800/0x167e6c29240312bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c29240312c2 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197686.003194:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776340736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788197686.003992:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197686.004051:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7012edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788197686.004109:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340736 00000100:00100000:0.0:1788197686.004118:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340736 00000100:00100000:0.0:1788197686.004170:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788197686.004179:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776340736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788197686.004205:0:14380:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788197686.004227:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788197686.004231:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788197686.004420:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776340736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 240us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197686.004429:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788197686.007564:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776340736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788197686.010445:0:14382:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788197686.010468:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6800/0x167e6c29240312bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240312c2 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197686.010531:0:14382:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6800/0x167e6c29240312bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c29240312c2 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197686.384133:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197687.413272:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788197687.822733:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788197687.822752:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788197688.430546:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197688.687080:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776340864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788197688.687146:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197688.687317:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340864 00000100:00100000:3.0:1788197688.687325:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340864 00000100:00100000:3.0:1788197688.687390:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197688.687401:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776340864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197688.687443:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197688.687490:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776340864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197688.687497:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788197688.687568:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788197688.687590:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776340864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788197688.687756:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788197689.454924:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788197689.711079:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788197689.711086:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788197689.711090:0:37:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788197689.711102:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93c706694000 using connection 192.168.206.140@tcp/0@lo 00000100:00100000:2.0:1788197689.711122:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93c7417f9500 x1875060776341248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788197689.711194:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776341120:0@lo:400:kworker.0 00000100:00100000:2.0:1788197689.711262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.711320:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788197689.711326:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb9dfa30-4633-465a-85d4-89e35609b060:3312:1875060776340992:0@lo:400:kworker.0 00000100:00100000:2.0:1788197689.711353:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.711376:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776341632:0@lo:400:kworker.0 00000100:00100000:2.0:1788197689.711403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.711429:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776341248:0@lo:8:kworker.0 00000100:00100000:2.0:1788197689.711452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.711478:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788197689.711499:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.711515:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788197689.711520:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776341504:0@lo:400:kworker.0 00000100:00100000:2.0:1788197689.711539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.711567:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776341120 00000100:00100000:2.0:1788197689.711573:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776341120 00000100:00100000:2.0:1788197689.711614:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776341248 00000100:00100000:2.0:1788197689.711623:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776341248 00000100:00100000:2.0:1788197689.711639:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197689.711647:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776341120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788197689.711693:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776341120:12345-0@lo:400:kworker.0 Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197689.711700:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197689.711716:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197689.711721:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1875060776341248:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788197689.711744:0:15073:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1788197689.711771:0:15073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x167e6c29240312c9 00002000:00100000:2.0:1788197689.711785:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93c604cf8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788197689.711790:0:15073:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788197689.711793:0:15073:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788197689.712441:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776341632 00000100:00100000:1.0:1788197689.712447:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776341632 00000100:00100000:1.0:1788197689.712473:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776341376 00000100:00100000:1.0:1788197689.712475:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776341376 00000100:00100000:1.0:1788197689.712483:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776341504 00000100:00100000:1.0:1788197689.712485:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776341504 00000100:00100000:1.0:1788197689.712496:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788197689.712502:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776341632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197689.712543:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875060776341632:12345-0@lo:400:kworker.0 Request processed in 41us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197689.712549:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788197689.712577:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788197689.712583:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776341376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197689.712608:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776341376:12345-0@lo:400:kworker.0 Request processed in 26us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197689.712614:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788197689.712623:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788197689.712627:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776341504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197689.712646:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776341504:12345-0@lo:400:kworker.0 Request processed in 19us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197689.712651:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788197689.712673:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776340992 00000100:00100000:1.0:1788197689.712676:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776340992 00000100:00100000:1.0:1788197689.712695:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788197689.712702:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:3312:x1875060776340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197689.712740:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:3312:x1875060776340992:12345-0@lo:400:kworker.0 Request processed in 39us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197689.712747:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1788197689.712804:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7417fb100 x1875060776341504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197689.712816:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776341504:0@lo:400:kworker.0 00010000:00080000:1.0:1788197689.712854:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7417fa680 x1875060776341376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197689.712862:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776341376:0@lo:400:kworker.0 00000100:00100000:1.0:1788197689.712891:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb9dfa30-4633-465a-85d4-89e35609b060:3312:1875060776340992:0@lo:400:kworker.0 00010000:00080000:1.0:1788197689.712903:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7417fad80 x1875060776341632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788197705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197689.712911:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875060776341632:0@lo:400:kworker.0 00000100:00100000:1.0:1788197689.712921:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776341120:0@lo:400:kworker.0 00000100:00080000:0.0:1788197689.713134:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1788197689.714567:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788197689.714595:0:15073:0:(import.c:65:import_set_state_nolock()) ffff93c604cfd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788197689.714668:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875060776341248:12345-0@lo:8:kworker.0 Request processed in 2943us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197689.714677:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788197689.715131:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c7417f9500 x1875060776341248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788197714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788197689.715157:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788197689.715166:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788197689.715171:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788197689.715173:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93c706694000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788197689.715189:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788197689.715195:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875060776341248:0@lo:8:kworker.0 00000004:00080000:3.0:1788197689.715226:0:14410:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788197689.715580:0:14411:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788197689.715598:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1875060776341888:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788197689.715600:0:14410:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 485861776591ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788197689.715642:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.715663:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7012ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1788197689.715678:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776341888 00000100:00100000:2.0:1788197689.715684:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776341888 00000100:00100000:2.0:1788197689.715729:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788197689.715737:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1875060776341888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788197689.718108:0:15071:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788197689.718118:0:15071:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788197689.718123:0:15071:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1788197689.718524:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776341760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197689.718597:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197689.718665:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776341760 00000100:00100000:1.0:1788197689.718673:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776341760 00000100:00100000:1.0:1788197689.718722:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197689.718731:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776341760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788197689.718765:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197689.718810:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776341760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197689.718862:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788197689.718906:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93c74133ed80 x1875060776341760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788197705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788197689.718926:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776341760:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788197689.719105:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788197689.737949:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.738029:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738045:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.738049:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.738069:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738089:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738099:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738107:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738124:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197689.738136:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.738142:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738149:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.738162:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738171:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738187:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738194:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c29240312d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.738209:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.738211:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.738213:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.741478:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.741489:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.741506:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.741510:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.741516:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.741530:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.741538:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.741551:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742203:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788197689.742270:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197689.742278:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.742287:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197689.742291:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.742300:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.742319:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.742326:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.742346:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.742348:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.742350:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.742629:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.742635:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742644:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.742648:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.742653:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742663:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742671:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742678:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742693:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197689.742701:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.742705:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742717:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.742721:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742728:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742738:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742746:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c29240312de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.742760:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.742762:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.742763:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.749199:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.749213:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.749229:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.749233:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.749245:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.749260:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.749279:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.749286:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.753618:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788197689.754149:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197689.754159:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.754170:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197689.754175:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.754186:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.754207:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.754214:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c29240312e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.754232:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.754234:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.754235:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.754314:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.754321:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754332:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.754336:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.754342:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754353:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754361:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754367:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754392:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197689.754401:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.754405:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754412:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.754415:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754424:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754436:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754442:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c29240312ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754454:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.754456:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.754458:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.754869:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.754875:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754884:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.754893:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.754898:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754908:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754916:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754922:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.754967:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197689.755384:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.755391:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755399:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.755402:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.755406:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755415:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755423:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755435:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755448:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788197689.755457:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788197689.755461:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755468:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ce00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.755472:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755482:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755493:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755500:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e11f6ec8/0x167e6c29240312f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755513:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.755517:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755534:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155cc00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.755538:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755546:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755556:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755563:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f559b926/0x167e6c29240312fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.755575:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.755577:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.755578:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.755578:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.759781:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.759795:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.759812:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.759816:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.759845:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.759861:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.759877:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.759885:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.759911:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197689.760635:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.760643:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760653:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.760656:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.760660:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760671:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760679:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760686:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760709:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788197689.760719:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788197689.760724:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760731:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.760736:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760744:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760761:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760768:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a23719/0x167e6c2924031301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760784:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.760788:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760794:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155ca00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.760797:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760814:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760845:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760852:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041d61e59/0x167e6c2924031308 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.760866:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.760867:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.760869:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.761269:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.761276:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761285:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.761289:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.761293:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761302:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761310:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761323:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761337:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197689.761345:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.761349:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761355:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.761358:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761365:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761376:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761383:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c2e285/0x167e6c292403130f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761395:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.761397:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.761399:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.761786:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.761799:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761807:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.761810:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.761815:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761847:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761855:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761862:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761877:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197689.761886:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.761890:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761896:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155de00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.761899:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761906:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761924:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761932:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189730ed/0x167e6c2924031316 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.761943:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.761945:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.761947:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.763750:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.773269:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.773282:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773298:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.773303:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.773310:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773323:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773335:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773343:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773374:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788197689.773388:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788197689.773393:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773400:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197689.773405:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773413:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773430:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773437:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da5d30f9/0x167e6c292403131d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.773455:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.773456:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.773458:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.777330:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.777341:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.777357:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.777368:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.777375:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.777389:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.777398:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.777405:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.777424:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788197689.777992:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197689.778001:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.778011:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.778016:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.778026:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.778047:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.778066:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3d6df80/0x167e6c2924031324 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.778097:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.778099:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.778101:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.779337:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.779347:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.779361:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.779365:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.779371:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.779383:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.779394:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.779408:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.779434:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197689.781284:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.781296:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.781310:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.781313:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.781319:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.781332:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.781342:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.781349:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.781370:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788197689.782363:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.782373:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.782391:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.782395:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.782400:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.782411:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.782419:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.782427:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.782437:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788197689.784185:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788197689.784197:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784208:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155da00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.784213:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784223:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784243:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784250:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000707a912f/0x167e6c292403132b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784273:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197689.784277:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784283:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155c400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.784295:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784303:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784313:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784320:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5b3c076/0x167e6c2924031332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784332:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197689.784335:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784341:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.784344:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784351:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784360:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784367:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051981e03/0x167e6c2924031339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.784383:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.784385:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.784387:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.784394:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788197689.784621:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788197689.784646:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.784653:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.784664:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.784668:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.784675:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.784685:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.784705:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.784712:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.784779:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197689.785310:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.785316:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.785326:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.785330:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.785334:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.785343:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.785351:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.785359:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787174:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197689.787188:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787202:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.787206:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787217:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787237:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787244:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071b33fb2/0x167e6c2924031340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787263:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197689.787267:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787286:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.787289:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787296:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787308:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.787315:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.787316:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.787318:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.787414:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197689.787422:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4346f17/0x167e6c2924031347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788197689.788293:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.788301:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.788313:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.788317:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197689.788690:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.788784:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.788800:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.788810:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.788817:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.788937:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788197689.789032:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197689.789038:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.789046:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031000 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.789051:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.789070:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.789086:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.789099:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c670931/0x167e6c292403134e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.789119:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.789121:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.789123:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.789701:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.789709:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.789800:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.789804:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.789808:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.789848:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.789858:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.789864:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.789882:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788197689.790087:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197689.790093:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.790101:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.790104:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.790111:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.790124:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.790132:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ece7da6a/0x167e6c2924031355 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.790149:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.790151:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.790153:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.790642:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.790649:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.790658:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.790662:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.790667:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.790676:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.790694:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.790702:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.790839:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788197689.791064:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197689.791071:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.791079:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197689.791084:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.791093:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.791106:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.791113:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009045c28c/0x167e6c292403135c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197689.791129:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.791131:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197689.791133:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.798230:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.798246:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.798263:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.798267:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.798273:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.798288:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.798300:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.798309:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.798340:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197689.799098:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.799106:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.799116:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.799119:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.799123:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.799133:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.799142:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.799149:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.799174:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788197689.799683:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788197689.799691:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799700:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197689.799705:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799726:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799744:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799752:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f948dbb8/0x167e6c2924031363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799771:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197689.799775:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799781:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031600 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197689.799784:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799792:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799802:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799809:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a298ba88/0x167e6c292403136a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.799863:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.799865:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.799867:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.800382:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.800390:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.800399:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.800408:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.800413:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.800424:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.800433:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.800440:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.800589:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788197689.800710:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197689.800716:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.800723:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197689.800727:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.800735:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.800747:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.800755:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087ec5195/0x167e6c2924031371 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.800769:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.800772:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.800773:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197689.801092:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.801235:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.801242:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801251:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.801254:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.801259:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801269:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801276:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801289:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801313:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788197689.801326:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197689.801331:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.801349:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197689.801353:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.801360:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.801372:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.801379:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4f75aca/0x167e6c2924031378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.801393:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.801395:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197689.801397:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.801883:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.801889:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801899:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.801902:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.801906:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801916:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801924:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.801931:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.803340:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788197689.806146:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.806158:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.806179:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.806184:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.806190:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.806204:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.806215:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.806223:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806668:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788197689.806677:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806686:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030c00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197689.806692:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806701:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806734:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806743:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000665d19b9/0x167e6c292403137f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806763:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788197689.806767:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806784:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197689.806787:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806795:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806806:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.806814:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197689.806815:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197689.806818:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788197689.810439:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788197689.810469:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ad38f41/0x167e6c2924031386 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197689.810652:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788197689.811278:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788197689.811288:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.811302:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788197689.811307:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197689.811313:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.811341:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.811352:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.811361:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197689.811387:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788197689.811568:0:15071:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:1.0:1788197689.811671:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788197689.811672:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1875060776341888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 95932us (96026us total) trans 0 rc 0/0 00010000:00010000:1.0:1788197689.811678:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197689.811681:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788197689.811687:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197689.811691:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.811700:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.811717:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.811731:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a34f275/0x167e6c292403138d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197689.811749:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197689.811751:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197689.811752:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197689.812118:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1875060776341888:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788197689.812133:0:14411:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788197689.812180:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1875060776342016:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788197689.812559:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197689.812809:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342016 00000100:00100000:2.0:1788197689.812816:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342016 00000100:00100000:2.0:1788197689.812895:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788197689.812904:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14411:x1875060776342016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788197689.812943:0:15073:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788197689.812959:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c736addcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197689.820914:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14411:x1875060776342016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8004us (8347us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788197689.820925:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788197689.823808:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14411:1875060776342016:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788197689.823850:0:14411:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788197690.479086:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788197691.439252:0:16146:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg640-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788197691.512072:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788197691.825186:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788197692.531398:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197693.345173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197693.345919:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755373696 00000100:00100000:0.0:1788197693.345931:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755373696 00000100:00100000:0.0:1788197693.345982:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:0.0:1788197693.345990:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1875060755373696:12345-192.168.206.40@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788197693.346092:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a63de8f9-77dc-4699-8515-61ab34d36ea1@192.168.206.40@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1788197693.346121:0:14378:0:(genops.c:1385:class_connect()) connect: client a63de8f9-77dc-4699-8515-61ab34d36ea1, cookie 0x167e6c2924031394 00000100:00080000:0.0:1788197693.346262:0:14378:0:(import.c:65:import_set_state_nolock()) ffff93c6059e6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788197693.346336:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+5:2356:x1875060755373696:12345-192.168.206.40@tcp:250:mount.lustre.0 Request processed in 344us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.346344:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 75 00000100:00100000:2.0:1788197693.358859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197693.358973:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755373824 00000100:00100000:0.0:1788197693.358984:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755373824 00000100:00100000:0.0:1788197693.359054:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:0.0:1788197693.359065:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+5:13754:x1875060755373824:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788197693.359080:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197693.359099:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143600/0x167e6c292403139b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5afe expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.359129:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143600/0x167e6c292403139b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5afe expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.359142:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143600/0x167e6c292403139b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5afe expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.359151:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143600, rc 0) 00000100:00100000:0.0:1788197693.359350:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+6:13754:x1875060755373824:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 286us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.359358:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 76 00000100:00100000:2.0:1788197693.364175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.364340:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755373952 00000100:00100000:1.0:1788197693.364349:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755373952 00000100:00100000:1.0:1788197693.364402:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:1.0:1788197693.364412:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+6:13754:x1875060755373952:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788197693.364931:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+6:13754:x1875060755373952:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 517us (763us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788197693.364942:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 77 00000100:00100000:3.0:1788197693.367146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197693.367335:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374080 00000100:00100000:0.0:1788197693.367343:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374080 00000100:00100000:0.0:1788197693.367395:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:0.0:1788197693.367405:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+6:13754:x1875060755374080:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788197693.367422:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197693.367438:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742143a00/0x167e6c29240313a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5b05 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.367470:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742143a00/0x167e6c29240313a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b05 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.367481:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742143a00/0x167e6c29240313a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b05 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.367491:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742143a00, rc 0) 00000100:00100000:0.0:1788197693.367550:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605437450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+7:13754:x1875060755374080:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 147us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.367558:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 78 00000100:00100000:0.0:1788197693.372407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197693.372491:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374208 00000100:00100000:2.0:1788197693.372501:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374208 00000100:00100000:2.0:1788197693.372557:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:2.0:1788197693.372567:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+7:13754:x1875060755374208:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788197693.372891:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605436050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13754:x1875060755374208:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 324us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197693.372900:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 79 00000100:00100000:2.0:1788197693.377775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.377903:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374336 00000100:00100000:1.0:1788197693.377914:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374336 00000100:00100000:1.0:1788197693.377968:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:1.0:1788197693.377979:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13754:x1875060755374336:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788197693.378641:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13754:x1875060755374336:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 661us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197693.378651:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 80 00000100:00100000:3.0:1788197693.384818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197693.384950:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374464 00000100:00100000:0.0:1788197693.384959:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374464 00000100:00100000:0.0:1788197693.385023:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:0.0:1788197693.385044:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13772:x1875060755374464:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197693.385528:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13772:x1875060755374464:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 494us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.385544:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 81 00000100:00100000:2.0:1788197693.424423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.424909:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374592 00000100:00100000:1.0:1788197693.424918:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374592 00000100:00100000:1.0:1788197693.425077:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:1.0:1788197693.425101:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13772:x1875060755374592:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788197693.425769:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f108c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13772:x1875060755374592:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 668us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197693.425777:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 82 00000100:00100000:1.0:1788197693.443636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197693.443735:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374720 00000100:00100000:2.0:1788197693.443746:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374720 00000100:00100000:2.0:1788197693.443803:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:2.0:1788197693.443813:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+8:13754:x1875060755374720:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788197693.443864:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197693.443898:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030600/0x167e6c29240313a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5b2f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197693.443925:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030600/0x167e6c29240313a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b2f expref: 9 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197693.443936:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030600/0x167e6c29240313a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b2f expref: 9 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197693.443944:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030600, rc 0) 00000100:00100000:2.0:1788197693.444145:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f108850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+9:13754:x1875060755374720:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 333us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197693.444153:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 83 00000100:00100000:3.0:1788197693.449184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.449304:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374848 00000100:00100000:1.0:1788197693.449315:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374848 00000100:00100000:1.0:1788197693.449415:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:1.0:1788197693.449425:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+9:13754:x1875060755374848:12345-192.168.206.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788197693.449451:0:14379:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788197693.449475:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788197693.449479:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788197693.449482:0:14379:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788197693.449485:0:14379:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788197693.455074:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+9:13754:x1875060755374848:12345-192.168.206.40@tcp:256:mount.lustre.0 Request processed in 5639us (5888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197693.455089:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 84 00000100:00100000:3.0:1788197693.463177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197693.463460:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755374976 00000100:00100000:0.0:1788197693.463471:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755374976 00000100:00100000:0.0:1788197693.463523:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:0.0:1788197693.463533:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+9:13754:x1875060755374976:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788197693.463548:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197693.463564:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5b36 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.463591:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.463602:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197693.463611:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c742142600, rc 0) 00000100:00100000:0.0:1788197693.463668:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13754:x1875060755374976:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 136us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.463675:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 85 00000100:00100000:3.0:1788197693.467388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.467588:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755375104 00000100:00100000:1.0:1788197693.467598:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755375104 00000100:00100000:1.0:1788197693.467647:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:1.0:1788197693.467656:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13754:x1875060755375104:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788197693.468141:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13754:x1875060755375104:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 482us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197693.468150:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 86 00000100:00100000:3.0:1788197693.469815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197693.470099:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755375232 00000100:00100000:2.0:1788197693.470107:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755375232 00000100:00100000:2.0:1788197693.470156:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:2.0:1788197693.470165:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13754:x1875060755375232:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788197693.470545:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13754:x1875060755375232:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 379us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197693.470553:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 87 00000100:00100000:3.0:1788197693.474192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197693.474274:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755375360 00000100:00100000:0.0:1788197693.474283:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755375360 00000100:00100000:0.0:1788197693.474324:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:0.0:1788197693.474334:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13779:x1875060755375360:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197693.474615:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13779:x1875060755375360:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 281us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.474624:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 88 00000100:00100000:2.0:1788197693.482979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.483178:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755375488 00000100:00100000:1.0:1788197693.483187:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755375488 00000100:00100000:1.0:1788197693.483240:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:1.0:1788197693.483248:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13779:x1875060755375488:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788197693.483484:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13779:x1875060755375488:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 235us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197693.483493:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 89 00000100:00100000:3.0:1788197693.496311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.496859:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755375616 00000100:00100000:1.0:1788197693.496870:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755375616 00000100:00100000:1.0:1788197693.496932:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:1.0:1788197693.496940:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1875060755375616:12345-192.168.206.40@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788197693.496982:0:14388:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c760e63f-6b9c-472f-8180-474aecfbc764@192.168.206.40@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1788197693.497045:0:14388:0:(genops.c:1385:class_connect()) connect: client c760e63f-6b9c-472f-8180-474aecfbc764, cookie 0x167e6c29240313b7 00000004:00100000:1.0:1788197693.497083:0:14388:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788197693.497090:0:14388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788197693.546581:0:14388:0:(import.c:65:import_set_state_nolock()) ffff93c6057c6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788197693.546708:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+6:2356:x1875060755375616:12345-192.168.206.40@tcp:38:mount.lustre.0 Request processed in 49765us (50405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197693.546719:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:3.0:1788197693.549407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197693.549541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.551623:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755375744 00000100:00100000:1.0:1788197693.551637:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755375744 00000100:00100000:0.0:1788197693.551726:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755375872 00000100:00100000:0.0:1788197693.551730:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755375872 00000100:00100000:0.0:1788197693.551769:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1788197693.551779:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+7:0:x1875060755375744:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788197693.551838:0:14386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788197693.551895:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197693.551925:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+7:0:x1875060755375744:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 146us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.551932:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1788197693.551951:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:0.0:1788197693.551957:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+6:13754:x1875060755375872:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788197693.551981:0:14386:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788197693.552013:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+6:13754:x1875060755375872:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 56us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.552019:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00010000:00010000:0.0:1788197693.552400:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197693.553501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197693.553563:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376000 00000100:00100000:0.0:1788197693.553571:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376000 00000100:00100000:0.0:1788197693.553622:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1788197693.553630:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+6:13754:x1875060755376000:12345-192.168.206.40@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788197693.553692:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+6:13754:x1875060755376000:12345-192.168.206.40@tcp:40:mount.lustre.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.553699:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1788197693.555098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197693.555264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197693.555335:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376128 00000100:00100000:2.0:1788197693.555342:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376128 00000100:00100000:2.0:1788197693.555380:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376256 00000100:00100000:2.0:1788197693.555384:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376256 00000100:00100000:2.0:1788197693.555397:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1788197693.555404:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875060755376128:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788197693.555430:0:15071:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c760e63f-6b9c-472f-8180-474aecfbc764@192.168.206.40@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1788197693.555456:0:15071:0:(genops.c:1385:class_connect()) connect: client c760e63f-6b9c-472f-8180-474aecfbc764, cookie 0x167e6c29240313be 00002000:00100000:2.0:1788197693.555467:0:15071:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c760e63f-6b9c-472f-8180-474aecfbc764/ffff93c6057c0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788197693.555489:0:15071:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788197693.555796:0:15071:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788197693.555860:0:15071:0:(import.c:65:import_set_state_nolock()) ffff93c6057c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788197693.555914:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+6:2356:x1875060755376128:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 509us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197693.555935:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:2.0:1788197693.555952:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1788197693.555957:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875060755376256:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788197693.556328:0:15071:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c760e63f-6b9c-472f-8180-474aecfbc764@192.168.206.40@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1788197693.556346:0:15071:0:(genops.c:1385:class_connect()) connect: client c760e63f-6b9c-472f-8180-474aecfbc764, cookie 0x167e6c29240313c5 00002000:00100000:2.0:1788197693.556352:0:15071:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c760e63f-6b9c-472f-8180-474aecfbc764/ffff93c604cf9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788197693.556366:0:15071:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788197693.556490:0:15071:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788197693.556510:0:15071:0:(import.c:65:import_set_state_nolock()) ffff93c604cfb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788197693.556541:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+6:2356:x1875060755376256:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 581us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197693.556549:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1788197693.558424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197693.558503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.558770:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376384 00000100:00100000:1.0:1788197693.558780:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376384 00000100:00100000:1.0:1788197693.558894:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:1.0:1788197693.558905:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+6:13754:x1875060755376384:12345-192.168.206.40@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788197693.558946:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376512 00000100:00100000:0.0:1788197693.558950:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376512 00000100:00100000:0.0:1788197693.559486:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 90 00000100:00100000:0.0:1788197693.559496:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:2357:x1875060755376512:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197693.559570:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:2357:x1875060755376512:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 76us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197693.559578:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 90 00000004:00080000:1.0:1788197693.560047:0:14389:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1080us 00000004:00200000:2.0:1788197693.595071:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788197693.595378:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+6:13754:x1875060755376384:12345-192.168.206.40@tcp:33:mount.lustre.0 Request processed in 36469us (36957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197693.595392:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:2.0:1788197693.780145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197693.780246:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376640 00000100:00100000:1.0:1788197693.780256:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376640 00000100:00100000:1.0:1788197693.780315:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1788197693.780325:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+6:13800:x1875060755376640:12345-192.168.206.40@tcp:101:mkdir.0 00010000:00010000:1.0:1788197693.780346:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197693.780383:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240313cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5b60 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197693.780449:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c29240313d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197693.780464:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c29240313d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197693.780480:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c29240313d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197693.780510:0:14387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788197693.780514:0:14387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197693.780545:0:14387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c29240313d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197693.780568:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240313cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b60 expref: 8 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197693.780585:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c29240313d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b60 expref: 7 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197693.780594:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:1.0:1788197693.780597:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788197693.780601:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe400, rc 0) 00000100:00100000:1.0:1788197693.780657:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+7:13800:x1875060755376640:12345-192.168.206.40@tcp:101:mkdir.0 Request processed in 334us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197693.780664:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1788197693.806091:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776342144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197693.806170:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197693.806234:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342144 00000100:00100000:3.0:1788197693.806251:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342144 00000100:00080000:1.0:1788197693.806284:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197693.806311:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788197693.806323:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776342144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197693.806345:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197693.806401:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776342144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197693.806409:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788197693.806509:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776342144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197694.574253:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197694.830283:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776342272:0@lo:400:kworker.0 00000100:00100000:0.0:1788197694.830366:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776342656:0@lo:400:kworker.0 00000100:00100000:0.0:1788197694.830403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197694.830471:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776342400:0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.830512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197694.830557:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776342912:0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.830584:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197694.830607:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197694.830615:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776342528:0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.830643:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197694.830817:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342656 00000100:00100000:1.0:1788197694.830844:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342656 00000100:00100000:0.0:1788197694.830854:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342400 00000100:00100000:1.0:1788197694.830885:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342912 00000100:00100000:1.0:1788197694.830889:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342912 00000100:00100000:1.0:1788197694.830916:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788197694.830925:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776342656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.830988:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776342656:12345-0@lo:400:kworker.0 Request processed in 63us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197694.830996:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788197694.831012:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788197694.831038:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776342912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197694.831046:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342400 00000100:00100000:1.0:1788197694.831079:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776342912:12345-0@lo:400:kworker.0 Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197694.831081:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342528 00000100:00100000:0.0:1788197694.831086:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342528 00000100:00100000:1.0:1788197694.831090:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788197694.831112:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788197694.831113:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788197694.831120:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197694.831121:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776342400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197694.831162:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776342400:12345-0@lo:400:kworker.0 Request processed in 43us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197694.831168:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788197694.831180:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776342912:0@lo:400:kworker.0 00000100:00100000:0.0:1788197694.831185:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788197694.831194:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875060776342528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.831211:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776342400:0@lo:400:kworker.0 00000100:00100000:0.0:1788197694.831233:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875060776342528:12345-0@lo:400:kworker.0 Request processed in 39us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197694.831234:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776342528:0@lo:400:kworker.0 00000100:00100000:2.0:1788197694.831254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197694.831381:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776342656:0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.831410:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342272 00000100:00100000:1.0:1788197694.831414:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342272 00000100:00100000:1.0:1788197694.831441:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788197694.831449:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+19:3314:x1875060776342272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.831486:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f109850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+19:3314:x1875060776342272:12345-0@lo:400:kworker.0 Request processed in 39us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197694.831494:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788197694.832350:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788197694.832530:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776342272:0@lo:400:kworker.0 00000100:00100000:2.0:1788197694.832543:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776342784:0@lo:400:kworker.0 00000100:00100000:2.0:1788197694.832595:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197694.833359:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776343040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788197694.833403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197694.833440:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343040 00000100:00100000:3.0:1788197694.833445:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343040 00000100:00100000:3.0:1788197694.833477:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197694.833485:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776343040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197694.833503:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197694.833555:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875060776343040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197694.833561:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788197694.833596:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776343040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197694.834507:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776342784 00000100:00100000:1.0:1788197694.834514:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776342784 00000100:00100000:1.0:1788197694.834572:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788197694.834581:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776342784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197694.834643:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875060776342784:12345-0@lo:400:kworker.0 Request processed in 63us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197694.834650:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788197694.834705:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875060776342784:0@lo:400:kworker.0 00000100:00080000:2.0:1788197694.835775:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788197694.909306:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c760e63f-6b9c-472f-8180-474aecfbc764 00000001:00080000:1.0:1788197694.909325:0:7661:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788197694.909438:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788197695.598093:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197695.764286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197695.764591:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376768 00000100:00100000:1.0:1788197695.764601:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376768 00000100:00100000:1.0:1788197695.764733:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1788197695.764756:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+7:13852:x1875060755376768:12345-192.168.206.40@tcp:41:lfs.0 00000004:00000024:1.0:1788197695.764799:0:14388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788197695.764917:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+7:13852:x1875060755376768:12345-192.168.206.40@tcp:41:lfs.0 Request processed in 163us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197695.764926:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:3.0:1788197695.768398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197695.768976:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755376896 00000100:00100000:0.0:1788197695.768987:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755376896 00000100:00080000:2.0:1788197695.770262:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788197695.770271:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197695.773380:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1788197695.773397:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c760e63f-6b9c-472f-8180-474aecfbc764+6:13852:x1875060755376896:12345-192.168.206.40@tcp:13:lfs.0 00002000:00000024:0.0:1788197695.773433:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197695.773526:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c760e63f-6b9c-472f-8180-474aecfbc764+6:13852:x1875060755376896:12345-192.168.206.40@tcp:13:lfs.0 Request processed in 134us (5138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197695.773546:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1788197695.778266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197695.778400:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377024 00000100:00100000:2.0:1788197695.778410:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377024 00000100:00100000:2.0:1788197695.778813:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:2.0:1788197695.778856:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c760e63f-6b9c-472f-8180-474aecfbc764+5:13852:x1875060755377024:12345-192.168.206.40@tcp:13:lfs.0 00002000:00000024:2.0:1788197695.778893:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788197695.778968:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c760e63f-6b9c-472f-8180-474aecfbc764+5:13852:x1875060755377024:12345-192.168.206.40@tcp:13:lfs.0 Request processed in 146us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197695.778976:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00080000:1.0:1788197695.781049:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788197696.012491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197696.012637:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377152 00000100:00100000:0.0:1788197696.012649:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377152 00000100:00100000:0.0:1788197696.012706:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:0.0:1788197696.012717:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+10:13885:x1875060755377152:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788197696.012732:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197696.012748:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7414f2a00/0x167e6c29240313da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5b67 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197696.012777:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7414f2a00/0x167e6c29240313da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b67 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197696.012788:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7414f2a00/0x167e6c29240313da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b67 expref: 11 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197696.012797:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7414f2a00, rc 0) 00000100:00100000:0.0:1788197696.012898:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13885:x1875060755377152:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 182us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197696.012905:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 92 00000100:00100000:0.0:1788197696.019014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197696.019137:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377280 00000100:00100000:3.0:1788197696.019146:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377280 00000100:00100000:3.0:1788197696.019203:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:3.0:1788197696.019213:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13885:x1875060755377280:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788197696.021066:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f10b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13885:x1875060755377280:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 1845us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197696.021079:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 93 00000100:00100000:2.0:1788197696.035089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197696.036383:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377408 00000100:00100000:1.0:1788197696.036396:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377408 00000100:00100000:1.0:1788197696.036463:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:1.0:1788197696.036473:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73f108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13885:x1875060755377408:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788197696.036875:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73f108050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13885:x1875060755377408:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 401us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197696.036884:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 94 00000100:00100000:1.0:1788197696.049190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197696.049448:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377536 00000100:00100000:0.0:1788197696.049459:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377536 00000100:00100000:0.0:1788197696.049523:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:0.0:1788197696.049534:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13891:x1875060755377536:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788197696.049982:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13891:x1875060755377536:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 448us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197696.049998:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 95 00000100:00100000:0.0:1788197696.089641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197696.089725:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377664 00000100:00100000:3.0:1788197696.089734:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377664 00000100:00100000:3.0:1788197696.089786:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:3.0:1788197696.089796:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13891:x1875060755377664:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788197696.090117:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13891:x1875060755377664:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 321us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197696.090125:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 96 00000100:00100000:3.0:1788197696.095506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197696.095700:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377792 00000100:00100000:2.0:1788197696.095709:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377792 00000100:00100000:2.0:1788197696.095758:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:2.0:1788197696.095768:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13885:x1875060755377792:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788197696.095784:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197696.095800:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700031a00/0x167e6c29240313e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5b91 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197696.095862:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700031a00/0x167e6c29240313e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b91 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197696.095872:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700031a00/0x167e6c29240313e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b91 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197696.095891:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031a00, rc 0) 00000100:00100000:2.0:1788197696.095962:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13885:x1875060755377792:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 195us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197696.095970:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 97 00000100:00100000:1.0:1788197696.098542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197696.098628:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755377920 00000100:00100000:0.0:1788197696.098637:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755377920 00000100:00100000:0.0:1788197696.098689:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:0.0:1788197696.098698:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13885:x1875060755377920:12345-192.168.206.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788197696.098719:0:14378:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788197696.098742:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788197696.098745:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788197696.098749:0:14378:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788197696.098751:0:14378:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788197696.102411:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13885:x1875060755377920:12345-192.168.206.40@tcp:256:mount.lustre.0 Request processed in 3703us (3867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197696.102425:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 98 00000100:00100000:2.0:1788197696.104940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197696.105147:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378048 00000100:00100000:3.0:1788197696.105158:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378048 00000100:00100000:3.0:1788197696.105207:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:3.0:1788197696.105217:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13885:x1875060755378048:12345-192.168.206.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788197696.105234:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197696.105252:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5b98 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.105280:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.105341:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.105352:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6600, rc 0) 00000100:00100000:3.0:1788197696.105412:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13885:x1875060755378048:12345-192.168.206.40@tcp:101:mount.lustre.0 Request processed in 196us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197696.105419:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 99 00000100:00100000:1.0:1788197696.107989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197696.108771:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378176 00000100:00100000:2.0:1788197696.108782:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378176 00000100:00100000:2.0:1788197696.109754:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:2.0:1788197696.109772:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13885:x1875060755378176:12345-192.168.206.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788197696.110134:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13885:x1875060755378176:12345-192.168.206.40@tcp:501:mount.lustre.0 Request processed in 369us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197696.110144:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 100 00000100:00100000:0.0:1788197696.113135:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197696.113287:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378304 00000100:00100000:2.0:1788197696.113296:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378304 00000100:00100000:2.0:1788197696.113390:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:2.0:1788197696.113400:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13885:x1875060755378304:12345-192.168.206.40@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788197696.113708:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13885:x1875060755378304:12345-192.168.206.40@tcp:503:mount.lustre.0 Request processed in 309us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197696.113716:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 101 00000100:00100000:0.0:1788197696.117769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197696.118144:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378432 00000100:00100000:2.0:1788197696.118154:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378432 00000100:00100000:2.0:1788197696.118206:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:2.0:1788197696.118216:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13895:x1875060755378432:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788197696.118608:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13895:x1875060755378432:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 391us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197696.118616:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 102 00000100:00100000:1.0:1788197696.136202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197696.136456:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378560 00000100:00100000:2.0:1788197696.136467:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378560 00000100:00100000:2.0:1788197696.136536:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:2.0:1788197696.136545:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13895:x1875060755378560:12345-192.168.206.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788197696.136817:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13895:x1875060755378560:12345-192.168.206.40@tcp:502:llog_process_th.0 Request processed in 261us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197696.136873:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 103 00000100:00100000:0.0:1788197696.141655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197696.141870:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378688 00000100:00100000:1.0:1788197696.141885:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378688 00000100:00100000:1.0:1788197696.141941:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1788197696.141955:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1875060755378688:12345-192.168.206.40@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788197696.141984:0:14387:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b@192.168.206.40@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1788197696.142034:0:14387:0:(genops.c:1385:class_connect()) connect: client 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b, cookie 0x167e6c29240313ef 00000004:00100000:1.0:1788197696.142063:0:14387:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788197696.142189:0:14387:0:(import.c:65:import_set_state_nolock()) ffff93c737231800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788197696.142371:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:2356:x1875060755378688:12345-192.168.206.40@tcp:38:mount.lustre.0 Request processed in 420us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197696.142378:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1788197696.150615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197696.150718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197696.151007:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378944 00000100:00100000:0.0:1788197696.151017:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378944 00000100:00100000:0.0:1788197696.151109:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755378816 00000100:00100000:0.0:1788197696.151113:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755378816 00000100:00100000:0.0:1788197696.151132:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1788197696.151142:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+7:13885:x1875060755378944:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788197696.151180:0:14388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788197696.151262:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+7:13885:x1875060755378944:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 121us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197696.151269:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1788197696.151295:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:0.0:1788197696.151302:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:0:x1875060755378816:12345-192.168.206.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788197696.151327:0:14388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788197696.151351:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:0:x1875060755378816:12345-192.168.206.40@tcp:41:mount.lustre.0 Request processed in 49us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197696.151358:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00080000:1.0:1788197696.151948:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197696.155125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197696.155369:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379072 00000100:00100000:2.0:1788197696.155378:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379072 00000100:00100000:2.0:1788197696.155429:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1788197696.155438:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:13885:x1875060755379072:12345-192.168.206.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788197696.155510:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:13885:x1875060755379072:12345-192.168.206.40@tcp:40:mount.lustre.0 Request processed in 74us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197696.155518:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1788197696.170700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197696.170751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197696.170900:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379456 00000100:00100000:1.0:1788197696.170911:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379456 00000100:00100000:1.0:1788197696.170967:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:1.0:1788197696.170978:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:13885:x1875060755379456:12345-192.168.206.40@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788197696.171063:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788197696.171159:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:13885:x1875060755379456:12345-192.168.206.40@tcp:33:mount.lustre.0 Request processed in 182us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197696.171166:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:0.0:1788197696.171677:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379200 00000100:00100000:0.0:1788197696.171682:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379200 00000100:00100000:0.0:1788197696.171715:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:0.0:1788197696.171721:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1875060755379200:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788197696.171744:0:15071:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b@192.168.206.40@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1788197696.171772:0:15071:0:(genops.c:1385:class_connect()) connect: client 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b, cookie 0x167e6c29240313f6 00002000:00100000:0.0:1788197696.171781:0:15071:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b/ffff93c6059e2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788197696.171790:0:15071:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788197696.171923:0:15071:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788197696.171948:0:15071:0:(import.c:65:import_set_state_nolock()) ffff93c6059e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788197696.171982:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:2356:x1875060755379200:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 260us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197696.171990:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1788197696.178699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197696.178804:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379328 00000100:00100000:3.0:1788197696.178816:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379328 00000100:00100000:3.0:1788197696.178897:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:3.0:1788197696.178906:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1875060755379328:12345-192.168.206.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788197696.178939:0:15073:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b@192.168.206.40@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:3.0:1788197696.178975:0:15073:0:(genops.c:1385:class_connect()) connect: client 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b, cookie 0x167e6c29240313fd 00002000:00100000:3.0:1788197696.178988:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b/ffff93c60702b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788197696.179000:0:15073:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788197696.179243:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788197696.179391:0:15073:0:(import.c:65:import_set_state_nolock()) ffff93c60702e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788197696.179561:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:2356:x1875060755379328:12345-192.168.206.40@tcp:8:mount.lustre.0 Request processed in 654us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197696.179570:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:1.0:1788197696.345912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197696.346036:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379584 00000100:00100000:3.0:1788197696.346046:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379584 00000100:00100000:3.0:1788197696.346103:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1788197696.346113:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:13916:x1875060755379584:12345-192.168.206.40@tcp:101:mkdir.0 00010000:00010000:3.0:1788197696.346145:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197696.346166:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7400/0x167e6c2924031404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bc2 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.346225:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.346247:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.346260:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197696.346292:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788197696.346295:0:14386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788197696.346314:0:14386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.346339:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7400/0x167e6c2924031404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 8 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.346356:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197696.346364:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:3.0:1788197696.346367:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788197696.346371:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7a00, rc 0) 00000100:00100000:3.0:1788197696.346435:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+7:13916:x1875060755379584:12345-192.168.206.40@tcp:101:mkdir.0 Request processed in 323us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197696.346451:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00010000:00010000:3.0:1788197696.623116:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197697.646980:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788197697.942865:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b 00000001:00100000:3.0:1788197697.942887:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c760e63f-6b9c-472f-8180-474aecfbc764 00010000:00010000:3.0:1788197698.671984:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788197698.907316:0:16347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788197698.927445:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776343168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788197698.927515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197698.927966:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343168 00000100:00100000:3.0:1788197698.927976:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343168 00000100:00100000:3.0:1788197698.928045:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788197698.928056:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776343168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197698.928088:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197698.929074:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776343168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1013us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197698.929096:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788197698.929767:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197698.930124:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776343168:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788197698.966403:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b 00000001:00100000:3.0:1788197698.966420:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c760e63f-6b9c-472f-8180-474aecfbc764 00010000:00010000:0.0:1788197699.698701:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197699.959718:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776343296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788197699.959786:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197699.959878:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343296 00000100:00100000:0.0:1788197699.959885:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343296 00000100:00100000:0.0:1788197699.959936:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788197699.959968:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776343296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788197699.960000:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788197699.960062:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776343296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197699.960070:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788197699.960089:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788197699.960117:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788197699.960137:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776343296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197699.961028:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776343424:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961072:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197699.961100:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776343936:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197699.961142:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788197699.961148:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776343552:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961170:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197699.961210:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343424 00000100:00100000:1.0:1788197699.961215:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343424 00000100:00100000:1.0:1788197699.961252:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788197699.961259:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7087ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:3311:x1875060776343424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961297:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7087ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:3311:x1875060776343424:12345-0@lo:400:kworker.0 Request processed in 37us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197699.961303:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788197699.961329:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343936 00000100:00100000:1.0:1788197699.961333:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343936 00000100:00100000:1.0:1788197699.961363:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788197699.961370:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776343936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961398:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875060776343936:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197699.961404:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788197699.961420:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343552 00000100:00100000:1.0:1788197699.961423:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343552 00000100:00100000:1.0:1788197699.961446:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788197699.961452:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776343552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961479:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875060776343552:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197699.961485:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788197699.961876:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776343680:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197699.961926:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788197699.961932:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.961952:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788197699.961974:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197699.961984:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343680 00000100:00100000:1.0:1788197699.961987:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343680 00000100:00100000:1.0:1788197699.962025:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776343808 00000100:00100000:1.0:1788197699.962029:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776343808 00000100:00100000:1.0:1788197699.962048:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788197699.962054:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776343680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.962088:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875060776343680:12345-0@lo:400:kworker.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197699.962094:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788197699.962105:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788197699.962110:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776343808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.962134:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776343808:12345-0@lo:400:kworker.0 Request processed in 25us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197699.962140:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788197699.962154:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197699.962175:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.962185:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875060776343680:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.962208:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875060776343552:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.962216:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776343424:0@lo:400:kworker.0 00000100:00100000:1.0:1788197699.962225:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875060776343936:0@lo:400:kworker.0 00000001:00100000:1.0:1788197699.999041:0:7661:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b63d12c-2667-4384-9d52-ebbdc0b3cd6b 00010000:00010000:3.0:1788197700.726072:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788197701.040413:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788197701.230453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197701.230550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197701.230583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197701.230618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197701.230645:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379968 00000100:00100000:1.0:1788197701.230666:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379968 00000100:00100000:1.0:1788197701.230719:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380480 00000100:00100000:1.0:1788197701.230723:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380480 00000100:00100000:1.0:1788197701.230743:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1788197701.230753:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755379968:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197701.230843:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380224 00000100:00100000:3.0:1788197701.230849:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380224 00000100:00100000:3.0:1788197701.230887:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:3.0:1788197701.230895:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:2359:x1875060755380224:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197701.230967:0:15071:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788197701.230977:0:15071:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788197701.231092:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:2.0:1788197701.231100:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755380480:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197701.231175:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755379968:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 421us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197701.231182:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00080000:1.0:1788197701.231203:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788197701.231207:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788197701.231209:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788197701.231450:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379712 00000100:00100000:0.0:1788197701.231455:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379712 00000100:00100000:0.0:1788197701.231485:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:0.0:1788197701.231492:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:2359:x1875060755379712:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197701.235077:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:2359:x1875060755380224:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 4103us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197701.235097:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1788197701.235276:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755380480:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 4174us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197701.235285:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:0.0:1788197701.236103:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:2359:x1875060755379712:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 4607us (5656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197701.236260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197701.236323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197701.236372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197701.236457:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380096 00000100:00100000:1.0:1788197701.236465:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380096 00000100:00100000:1.0:1788197701.236509:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380352 00000100:00100000:1.0:1788197701.236513:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380352 00000100:00100000:1.0:1788197701.236534:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1788197701.236546:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1788197701.236547:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755380096:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:3.0:1788197701.236562:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755380352:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:1.0:1788197701.236601:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755380096:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197701.236608:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1788197701.236624:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755380352:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 65us (249us total) trans 0 rc 0/0 00000100:00080000:1.0:1788197701.236627:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788197701.236632:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788197701.236636:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:0.0:1788197701.236701:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 105 00000100:00100000:2.0:1788197701.236937:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755379840 00000100:00100000:2.0:1788197701.236943:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755379840 00000100:00100000:2.0:1788197701.236984:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:2.0:1788197701.236992:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+6:2359:x1875060755379840:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197701.237042:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+6:2359:x1875060755379840:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 51us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197701.237049:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00080000:0.0:1788197701.237421:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788197701.742232:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788197702.124857:0:16498:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe99c8a0f0 20000000:00000080:3.0:1788197702.124875:0:16498:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93c606067400 uarg=0000000000000000 20000000:01000000:3.0:1788197702.124910:0:16498:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788197702.124915:0:16498:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788197702.124919:0:16498:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788197702.125760:0:16499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788197702.126258:0:16498:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788197702.144455:0:16498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788197702.144486:0:16498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197702.144506:0:16498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031102 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197702.144516:0:16498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c292403114f expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197702.144526:0:16498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031283 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197702.144550:0:16498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197702.144558:0:16498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197702.144566:0:16498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.144672:0:16498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.144702:0:16498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 12 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.144718:0:16498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344064:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197702.144865:0:16498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.144875:0:16498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 12 pid: 14380 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.144884:0:16498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344192:192.168.206.40@tcp:104: 00010000:00010000:1.0:1788197702.144925:0:16498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c2924031283 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.144934:0:16498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c2924031283 expref: 18 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.144942:0:16498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344320:0@lo:104: 00000100:00100000:1.0:1788197702.144985:0:16498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197702.145033:0:16498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c292403114f expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.145042:0:16498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c292403114f expref: 18 pid: 14378 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.145051:0:16498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344448:0@lo:104: 00000100:00100000:1.0:1788197702.145072:0:16498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788197702.145112:0:16498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x167e6c2924031102 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.145120:0:16498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x167e6c2924031102 expref: 18 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.145127:0:16498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344576:0@lo:104: 00000100:00100000:1.0:1788197702.145149:0:16498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197702.145157:0:16498:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c704a40240 going to sleep for 11 seconds 00000100:00100000:3.0:1788197702.145305:0:14369:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788197702.145321:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776344320 00000100:00100000:3.0:1788197702.145329:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776344448 00000100:00100000:2.0:1788197702.145330:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776344320 00000100:00100000:3.0:1788197702.145336:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776344448 00000100:00100000:2.0:1788197702.145371:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776344576 00000100:00100000:2.0:1788197702.145375:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776344576 00000100:00100000:2.0:1788197702.145392:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788197702.145401:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+5:16498:x1875060776344320:12345-0@lo:104: 00010000:00010000:2.0:1788197702.145413:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197702.145680:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197702.145688:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+5:16498:x1875060776344320:12345-0@lo:104: Request processed in 288us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197702.145695:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788197702.145714:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788197702.145721:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c706678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+4:16498:x1875060776344576:12345-0@lo:104: 00010000:00010000:3.0:1788197702.145722:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197702.145733:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197702.145734:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.145745:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c742142200 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197702.145752:0:14374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.145762:0:14374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197702.145771:0:14374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197702.145778:0:14374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788197702.145789:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788197702.145797:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c706678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+4:16498:x1875060776344576:12345-0@lo:104: Request processed in 76us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197702.145803:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788197702.145809:0:14374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197702.145819:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788197702.145854:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+3:16498:x1875060776344448:12345-0@lo:104: 00010000:00010000:2.0:1788197702.145863:0:14370:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197702.145891:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788197702.145896:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb9dfa30-4633-465a-85d4-89e35609b060+3:16498:x1875060776344448:12345-0@lo:104: Request processed in 45us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197702.145901:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788197702.145990:0:14374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197702.146023:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146029:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c742142200/0x167e6c2924031283 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c292403128a expref: -99 pid: 15788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146040:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788197702.146043:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146049:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c74155d000 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197702.146052:0:14374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146059:0:14374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197702.146064:0:14374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197702.146069:0:14374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788197702.146084:0:14374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146091:0:14374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197702.146106:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146112:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c74155d000/0x167e6c2924031102 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924031109 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146127:0:14374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788197702.146130:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146135:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d7600 already unused, calling callback (ffffffffc1dd9c20) 10000000:00010000:3.0:1788197702.146138:0:14374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146145:0:14374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788197702.146151:0:14374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197702.146156:0:14374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788197702.146176:0:14374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146181:0:14374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788197702.146187:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146193:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.140@tcp lock: ffff93c7368d7600/0x167e6c292403114f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x167e6c2924031156 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.146205:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197702.146207:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788197702.146209:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197702.146300:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197702.146739:0:16498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344320:0@lo:104: 00000100:00100000:1.0:1788197702.146750:0:16498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344448:0@lo:104: 00000100:00100000:1.0:1788197702.146761:0:16498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344576:0@lo:104: 00000100:00100000:0.0:1788197702.147256:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776344960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788197702.147309:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197702.147395:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788197702.147402:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776344832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788197702.147423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197702.149339:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788197702.149366:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776344704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788197702.150087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197702.150150:0:16498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344064:192.168.206.40@tcp:104: 00000100:00100000:1.0:1788197702.150234:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776344960 00000100:00100000:1.0:1788197702.150241:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776344960 00010000:00010000:1.0:1788197702.150272:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292403114f expref: 19 pid: 14378 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.150307:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776344832 00000100:00100000:1.0:1788197702.150310:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776344832 00010000:00010000:1.0:1788197702.150321:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924031102 expref: 20 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.150335:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788197702.150343:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+20:3314:x1875060776344960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197702.150357:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197702.150363:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c292403114f expref: 20 pid: 14378 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.150373:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c292403114f expref: 20 pid: 14378 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.150396:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c736abfe00/0x167e6c2924031156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c292403114f expref: 20 pid: 14378 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.150410:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197702.150466:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+19:3314:x1875060776344960:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (3141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197702.150474:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788197702.150491:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788197702.150507:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+18:3314:x1875060776344832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197702.150516:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197702.150521:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924031102 expref: 18 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.150529:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c2924031102 expref: 18 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.150932:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142800/0x167e6c2924031109 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c2924031102 expref: 18 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.150944:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197702.150975:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+17:3314:x1875060776344832:12345-0@lo:103:ldlm_bl.0 Request processed in 478us (3550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197702.150982:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788197702.151027:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776344832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197702.151037:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb9dfa30-4633-465a-85d4-89e35609b060:3314:1875060776344960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788197702.151676:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197702.152318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197702.152390:0:16498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16498:1875060776344192:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197702.152418:0:16498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.155339:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776344704 00000100:00100000:1.0:1788197702.155369:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776344704 00010000:00010000:1.0:1788197702.155410:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924031283 expref: 17 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.155435:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380608 00000100:00100000:1.0:1788197702.155438:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380608 00010000:00010000:1.0:1788197702.155643:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 13 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.155661:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380736 00000100:00100000:1.0:1788197702.155665:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380736 00010000:00010000:1.0:1788197702.155680:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 14 pid: 14380 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.155693:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788197702.155701:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737c32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+17:3311:x1875060776344704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788197702.155713:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197702.155718:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x167e6c2924031283 expref: 17 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.155728:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x167e6c2924031283 expref: 17 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.155744:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c74155c800/0x167e6c292403128a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x167e6c2924031283 expref: 17 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197702.155753:0:14371:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788197702.155758:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197702.155765:0:14371:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788197702.155916:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737c32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb9dfa30-4633-465a-85d4-89e35609b060+16:3311:x1875060776344704:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197702.155989:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788197702.156052:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1788197702.156056:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb9dfa30-4633-465a-85d4-89e35609b060:3311:1875060776344704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788197702.156069:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a63de8f9-77dc-4699-8515-61ab34d36ea1+14:2359:x1875060755380608:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197702.156078:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197702.156084:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 14 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.156094:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 14 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.156105:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7368d6600/0x167e6c29240313e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b98 expref: 14 pid: 14379 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197702.156113:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197702.156222:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:3.0:1788197702.156232:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:2357:x1875060755380736:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197702.156243:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197702.156249:0:14371:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 13 pid: 14380 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156259:0:14371:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 13 pid: 14380 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156271:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c742142600/0x167e6c29240313b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b36 expref: 13 pid: 14380 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197702.156277:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:2359:x1875060755380608:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 207us (6191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197702.156287:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00010000:00010000:3.0:1788197702.156288:0:14371:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156309:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156329:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156337:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156344:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156351:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156364:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f3c00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197702.156369:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156377:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156402:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156413:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197702.156436:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:2357:x1875060755380736:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 206us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197702.156443:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00010000:00010000:3.0:1788197702.156899:0:16498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156908:0:16498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.156914:0:16498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93c7414f3c00/0x167e6c2924031412 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197702.767011:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197703.406580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197703.406651:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380864 00000100:00100000:3.0:1788197703.406661:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380864 00000100:00100000:3.0:1788197703.406716:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00100000:3.0:1788197703.406727:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+11:13769:x1875060755380864:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197703.406743:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197703.406768:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7600/0x167e6c2924031419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bc9 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.406796:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7600/0x167e6c2924031419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc9 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.406807:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7600/0x167e6c2924031419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc9 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.406816:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7600, rc 0) 00000100:00100000:3.0:1788197703.406889:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13769:x1875060755380864:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 164us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.406897:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 106 00000100:00100000:3.0:1788197703.408907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197703.408936:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755380992 00000100:00100000:3.0:1788197703.408943:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755380992 00000100:00100000:3.0:1788197703.408984:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 107 00000100:00100000:3.0:1788197703.409004:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13769:x1875060755380992:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.409234:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13769:x1875060755380992:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 241us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.409242:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 107 00000100:00100000:1.0:1788197703.421037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197703.421741:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755381120 00000100:00100000:3.0:1788197703.421750:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755381120 00000100:00100000:3.0:1788197703.421804:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 108 00000100:00100000:3.0:1788197703.421814:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13769:x1875060755381120:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.422050:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13769:x1875060755381120:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 236us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.422067:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 108 00000100:00100000:2.0:1788197703.433070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197703.436968:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755381248 00000100:00100000:3.0:1788197703.436984:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755381248 00000100:00100000:2.0:1788197703.437506:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 109 00000100:00100000:2.0:1788197703.437516:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+12:13769:x1875060755381248:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197703.437532:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197703.437548:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c700030c00/0x167e6c2924031420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bd0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197703.437586:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c700030c00/0x167e6c2924031420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bd0 expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197703.437597:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c700030c00/0x167e6c2924031420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bd0 expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197703.437606:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030c00, rc 0) 00000100:00100000:2.0:1788197703.437777:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13769:x1875060755381248:12345-192.168.206.40@tcp:101:ll_cfg_requeue.0 Request processed in 261us (4714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197703.437785:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 109 00000100:00100000:3.0:1788197703.444097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197703.445080:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755381376 00000100:00100000:1.0:1788197703.445090:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755381376 00000100:00100000:1.0:1788197703.445143:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:1.0:1788197703.445153:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13769:x1875060755381376:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197703.445415:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13769:x1875060755381376:12345-192.168.206.40@tcp:501:ll_cfg_requeue.0 Request processed in 262us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197703.445423:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 110 00000100:00100000:3.0:1788197703.451300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197703.451333:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755381504 00000100:00100000:3.0:1788197703.451342:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755381504 00000100:00100000:3.0:1788197703.451386:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 111 00000100:00100000:3.0:1788197703.451396:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13769:x1875060755381504:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.451586:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:13769:x1875060755381504:12345-192.168.206.40@tcp:503:ll_cfg_requeue.0 Request processed in 190us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.451594:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 111 10000000:01000000:1.0:1788197703.534283:0:14382:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788197703.534291:0:14382:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c604cfe000 from 10 10000000:01000000:1.0:1788197703.534296:0:14382:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788197703.534335:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abec00/0x167e6c2924031427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197703.534352:0:14382:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c736abec00/0x167e6c2924031427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197703.534364:0:14382:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c736abec00/0x167e6c2924031427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197703.534386:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788197703.534443:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197703.534491:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c704a40840 going to sleep for 11 seconds 00000100:00100000:3.0:1788197703.534552:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345088 00000100:00100000:3.0:1788197703.534560:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345088 00000100:00100000:3.0:1788197703.534607:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788197703.534616:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+16:14382:x1875060776345088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197703.534628:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197703.534639:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d7400/0x167e6c292403142e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031427 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.534659:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d7400/0x167e6c292403142e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031427 expref: 17 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.534670:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d7400/0x167e6c292403142e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031427 expref: 17 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.534678:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d7400, rc 0) 00000100:00100000:3.0:1788197703.534733:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+17:14382:x1875060776345088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.534740:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788197703.534860:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788197703.534874:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c736abec00/0x167e6c2924031427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403142e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197703.534884:0:14382:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c736abec00/0x167e6c2924031427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403142e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197703.534944:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788197703.534969:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197703.535005:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c704a40840 going to sleep for 11 seconds 00000100:00100000:3.0:1788197703.535112:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345216 00000100:00100000:3.0:1788197703.535117:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345216 00000100:00100000:3.0:1788197703.535148:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788197703.535156:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:14382:x1875060776345216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.535375:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:14382:x1875060776345216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.535382:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788197703.535411:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.535438:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.535476:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197703.535497:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788197703.535507:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345344 00000100:00100000:3.0:1788197703.535511:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345344 00000100:00100000:3.0:1788197703.535526:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788197703.535532:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:14382:x1875060776345344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.535664:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:14382:x1875060776345344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.535671:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788197703.535705:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788197703.540283:0:16568:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788197703.540381:0:14382:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788197703.540404:0:14382:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788197703.540432:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c736abec00/0x167e6c2924031427 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403142e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.540447:0:14382:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c736abec00/0x167e6c2924031427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403142e expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197703.540459:0:14382:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788197703.540463:0:14382:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c7049bd000 from 10 10000000:01000000:3.0:1788197703.540466:0:14382:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788197703.540502:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6400/0x167e6c2924031435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.540509:0:14382:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6400/0x167e6c2924031435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.540519:0:14382:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6400/0x167e6c2924031435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197703.540541:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.540595:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197703.540627:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a44840 going to sleep for 11 seconds 00000100:00100000:3.0:1788197703.540644:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345472 00000100:00100000:3.0:1788197703.542137:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345472 00000100:00100000:3.0:1788197703.542201:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788197703.542211:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+17:14382:x1875060776345472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197703.542224:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197703.542238:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6e00/0x167e6c292403143c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031435 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.542260:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6e00/0x167e6c292403143c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031435 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.542281:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6e00/0x167e6c292403143c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031435 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.542289:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6e00, rc 0) 00000100:00100000:3.0:1788197703.542358:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+18:14382:x1875060776345472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.542364:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788197703.542601:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788197703.542622:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6400/0x167e6c2924031435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403143c expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197703.542633:0:14382:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6400/0x167e6c2924031435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403143c expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197703.542699:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197703.542730:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197703.542762:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433000 going to sleep for 11 seconds 00000100:00100000:3.0:1788197703.542851:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345600 00000100:00100000:3.0:1788197703.542856:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345600 00000100:00100000:3.0:1788197703.543014:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788197703.543027:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+18:14382:x1875060776345600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.543296:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb9dfa30-4633-465a-85d4-89e35609b060+18:14382:x1875060776345600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.543303:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788197703.549135:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197703.549194:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788197703.549265:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197703.549364:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433000 going to sleep for 11 seconds 00000100:00100000:0.0:1788197703.552125:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345728 00000100:00100000:0.0:1788197703.552139:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345728 00000100:00100000:0.0:1788197703.552191:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788197703.552200:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+18:14382:x1875060776345728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197703.552419:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+18:14382:x1875060776345728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (3154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197703.552428:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788197703.553543:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788197703.554419:0:16569:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788197703.557165:0:14382:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788197703.557200:0:14382:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788197703.557213:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6400/0x167e6c2924031435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403143c expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.557228:0:14382:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6400/0x167e6c2924031435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403143c expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788197703.557240:0:14382:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788197703.557242:0:14382:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93c6054e9800 from 10 10000000:01000000:3.0:1788197703.557245:0:14382:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788197703.557281:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c2924031443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.557300:0:14382:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c2924031443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.557314:0:14382:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c2924031443 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197703.557342:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.557416:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197703.557464:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788197703.557493:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345856 00000100:00100000:3.0:1788197703.557501:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345856 00000100:00100000:3.0:1788197703.557551:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788197703.557562:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+18:14382:x1875060776345856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197703.557576:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197703.557591:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93c7368d6600/0x167e6c292403144a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x167e6c2924031443 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.557616:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93c7368d6600/0x167e6c292403144a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x167e6c2924031443 expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.557628:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93c7368d6600/0x167e6c292403144a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x167e6c2924031443 expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.557637:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6600, rc 0) 00000100:00100000:3.0:1788197703.557670:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776345856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.557677:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788197703.557730:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788197703.557743:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c2924031443 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403144a expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.557751:0:14382:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c2924031443 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x167e6c292403144a expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197703.557799:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.557857:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197703.557869:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c73716e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788197703.558099:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776345984 00000100:00100000:2.0:1788197703.558106:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776345984 00000100:00100000:2.0:1788197703.558268:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788197703.558277:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73b875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776345984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788197703.558542:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73b875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776345984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197703.558551:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788197703.558642:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776345984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788197703.558683:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c736f48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776346112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788197703.558722:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197703.563240:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788197703.567474:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776346112 00000100:00100000:3.0:1788197703.567488:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776346112 00000100:00100000:3.0:1788197703.567610:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788197703.567621:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776346112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788197703.567867:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:14382:x1875060776346112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (9144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197703.567875:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788197703.570287:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c736f48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb9dfa30-4633-465a-85d4-89e35609b060:14382:1875060776346112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788197703.571203:0:16570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788197703.571466:0:14382:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788197703.571495:0:14382:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788197703.571509:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c2924031443 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403144a expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197703.571521:0:14382:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.140@tcp lock: ffff93c7368d6c00/0x167e6c2924031443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x167e6c292403144a expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197703.791014:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197704.048858:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197704.048879:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776346240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788197704.048959:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197704.049041:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776346240 00000100:00100000:3.0:1788197704.049048:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776346240 00000100:00100000:3.0:1788197704.049095:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788197704.049103:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776346240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788197704.049131:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197704.049167:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776346240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197704.049174:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788197704.049191:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788197704.049218:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776346240:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788197704.814042:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788197705.070545:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb9dfa30-4633-465a-85d4-89e35609b060:3312:1875060776346368:0@lo:400:kworker.0 00000100:00100000:3.0:1788197705.070615:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197705.070665:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776346880:0@lo:400:kworker.0 00000100:00100000:3.0:1788197705.070704:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197705.070727:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788197705.070733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776346752:0@lo:400:kworker.0 00000100:00100000:3.0:1788197705.070752:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788197705.070786:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776346368 00000100:00100000:3.0:1788197705.070793:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776346368 00000100:00100000:3.0:1788197705.070866:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788197705.070875:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:3312:x1875060776346368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197705.070921:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb9dfa30-4633-465a-85d4-89e35609b060+19:3312:x1875060776346368:12345-0@lo:400:kworker.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197705.070928:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788197705.070956:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776346880 00000100:00100000:3.0:1788197705.070971:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776346880 00000100:00100000:3.0:1788197705.071014:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776346752 00000100:00100000:3.0:1788197705.071017:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776346752 00000100:00100000:3.0:1788197705.071030:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788197705.071036:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776346880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197705.071067:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875060776346880:12345-0@lo:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197705.071073:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788197705.071083:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788197705.071345:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197705.071374:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb9dfa30-4633-465a-85d4-89e35609b060:3312:1875060776346368:0@lo:400:kworker.0 00000100:00100000:0.0:1788197705.071392:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875060776346880:0@lo:400:kworker.0 00000100:00100000:0.0:1788197705.071430:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776346496:0@lo:400:kworker.0 00000100:00100000:0.0:1788197705.071460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197705.071479:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776347008:0@lo:400:kworker.0 00000100:00100000:0.0:1788197705.071498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197705.071514:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788197705.071519:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776346624:0@lo:400:kworker.0 00000100:00100000:0.0:1788197705.071538:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788197705.071558:0:14386:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788197705.071565:0:14386:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788197705.071662:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776347008 00000100:00100000:0.0:1788197705.071678:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776347008 00000100:00100000:0.0:1788197705.071706:0:14386:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788197705.071714:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788197705.071719:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776347008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197705.071755:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776347008:12345-0@lo:400:kworker.0 Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197705.071774:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788197705.071791:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197705.071809:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776347008:0@lo:400:kworker.0 00000100:00100000:3.0:1788197705.072187:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776346752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788197705.072236:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776346752:12345-0@lo:400:kworker.0 Request processed in 1147us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197705.072243:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788197705.072361:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776347136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197705.072391:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197705.072423:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776346496 00000100:00100000:1.0:1788197705.072426:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776346496 00000100:00100000:1.0:1788197705.072449:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776346624 00000100:00100000:1.0:1788197705.072452:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776346624 00000100:00100000:1.0:1788197705.072477:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788197705.072483:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776346496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197705.072519:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776346496:12345-0@lo:400:kworker.0 Request processed in 36us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197705.072526:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788197705.072538:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788197705.072544:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776346624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197705.072569:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875060776346624:12345-0@lo:400:kworker.0 Request processed in 25us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197705.072574:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788197705.072602:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776346624:0@lo:400:kworker.0 00000100:00100000:1.0:1788197705.072611:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875060776346496:0@lo:400:kworker.0 00000100:00080000:1.0:1788197705.072630:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788197705.072756:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776347136 00000100:00100000:3.0:1788197705.072760:0:15075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776347136 00000100:00100000:3.0:1788197705.072794:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788197705.072801:0:15075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776347136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788197705.073075:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788197705.073344:0:15075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776347136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 542us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197705.073351:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788197705.073451:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776346752:0@lo:400:kworker.0 00000100:00100000:1.0:1788197705.084039:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776347136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197705.303153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197705.304520:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755381632 00000100:00100000:0.0:1788197705.304532:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755381632 00000100:00100000:0.0:1788197705.304698:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:0.0:1788197705.304710:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+6:14426:x1875060755381632:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197705.304731:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197705.304755:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2c00/0x167e6c2924031451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bd7 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.304858:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.304872:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.304886:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.304900:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.304907:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.304914:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305657:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3400/0x167e6c2924031466 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305669:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3400/0x167e6c2924031466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305676:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3400/0x167e6c2924031466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197705.305703:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788197705.305706:0:14386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197705.305739:0:14386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3400/0x167e6c2924031466 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305750:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305756:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305763:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305768:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f2000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197705.305772:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305777:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305789:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:0.0:1788197705.305799:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197705.305804:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305810:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c2924031458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.305997:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306004:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306010:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306014:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f3c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197705.306017:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306023:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306032:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93c719ede200) 00010000:00010000:0.0:1788197705.306035:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197705.306038:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306043:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c292403145f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306076:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2c00/0x167e6c2924031451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bd7 expref: 8 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306101:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3400/0x167e6c2924031466 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bd7 expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.306108:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197705.306110:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197705.306112:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7414f3400, rc 0) 00000100:00080000:1.0:1788197705.306427:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788197705.307598:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+7:14426:x1875060755381632:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 2884us (4447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197705.307609:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1788197705.314990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197705.315148:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755381888 00000100:00100000:0.0:1788197705.315160:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755381888 00000100:00100000:0.0:1788197705.315225:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:0.0:1788197705.315235:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+7:14426:x1875060755381888:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197705.315255:0:16612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197705.315274:0:16612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2c00/0x167e6c292403146d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bde expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.315345:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.315357:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.315368:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.315429:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.315452:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.315460:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316022:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3000/0x167e6c2924031482 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316034:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3000/0x167e6c2924031482 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316042:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3000/0x167e6c2924031482 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197705.316052:0:16612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788197705.316428:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316435:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316441:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316446:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f3c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197705.316450:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316456:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316479:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93c719ede600) 00010000:00010000:0.0:1788197705.316481:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197705.316486:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316493:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c2924031474 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316505:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316511:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316516:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316521:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f2000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197705.316524:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316530:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316538:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93c719ede200) 00010000:00010000:0.0:1788197705.316540:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197705.316543:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.316548:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c292403147b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.317551:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2c00/0x167e6c292403146d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bde expref: 10 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.317571:0:16612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3000/0x167e6c2924031482 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bde expref: 9 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.317578:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c719edea00) 00010000:00010000:0.0:1788197705.317581:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197705.317583:0:16612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7414f3000, rc 0) 00000100:00100000:0.0:1788197705.317780:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+9:14426:x1875060755381888:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 2544us (2809us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788197705.317789:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1788197705.324331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.324397:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755382016 00000100:00100000:2.0:1788197705.324407:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755382016 00000100:00100000:2.0:1788197705.324493:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:2.0:1788197705.324504:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+9:14426:x1875060755382016:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788197705.324610:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+9:14426:x1875060755382016:12345-192.168.206.40@tcp:59:lhsmtool_posix.0 Request processed in 108us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197705.324618:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:2.0:1788197705.356670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197705.356751:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755382144 00000100:00100000:3.0:1788197705.356772:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755382144 00000100:00100000:3.0:1788197705.356861:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1788197705.356872:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+9:14432:x1875060755382144:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:3.0:1788197705.356901:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197705.356920:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924031490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5be5 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.356992:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357005:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357017:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357033:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357041:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357048:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357223:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357231:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357238:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357244:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7368d6000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197705.357255:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357262:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357274:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:3.0:1788197705.357277:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197705.357282:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357288:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6000/0x167e6c2924031497 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357300:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357305:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357310:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357315:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197705.357318:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357324:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357331:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c7065f6600) 00010000:00010000:3.0:1788197705.357334:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197705.357343:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357349:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403149e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357379:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924031490 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5be5 expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357389:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:3.0:1788197705.357391:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197705.357394:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d6200/0x167e6c2924031490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5be5 expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.357403:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7368d6200, rc 0) 00000100:00100000:3.0:1788197705.357467:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+9:14432:x1875060755382144:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 596us (805us total) trans 0 rc 301/301 00000100:00100000:3.0:1788197705.357474:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 18 00000100:00100000:3.0:1788197705.363143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197705.363286:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755382272 00000100:00100000:0.0:1788197705.363296:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755382272 00000100:00100000:0.0:1788197705.363349:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:0.0:1788197705.363360:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c760e63f-6b9c-472f-8180-474aecfbc764+9:14432:x1875060755382272:12345-192.168.206.40@tcp:700:lfs.0 00000100:00100000:0.0:1788197705.363444:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c760e63f-6b9c-472f-8180-474aecfbc764+9:14432:x1875060755382272:12345-192.168.206.40@tcp:700:lfs.0 Request processed in 86us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197705.363452:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:0.0:1788197705.365551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.365636:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755382528 00000100:00100000:2.0:1788197705.365644:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755382528 00000100:00100000:2.0:1788197705.365698:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 19 00000100:00100000:2.0:1788197705.365709:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+9:14432:x1875060755382528:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:2.0:1788197705.365759:0:14386:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197705.365798:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c29240313d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5b60 expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.365818:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:2.0:1788197705.366024:0:14386:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197705.366547:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.366564:0:14386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 5 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.366572:0:14386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.366605:0:14386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 5 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.366619:0:14386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 5 pid: 14386 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197705.366633:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14386:1875060776347264:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197705.366770:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c7094330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788197705.371124:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14386:1875060776347264:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197705.371154:0:14386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197705.374262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.374346:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755382656 00000100:00100000:1.0:1788197705.374356:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755382656 00010000:00010000:1.0:1788197705.374415:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 6 pid: 14386 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197705.374455:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:1.0:1788197705.374465:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:2360:x1875060755382656:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197705.374478:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197705.374485:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 6 pid: 14386 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.374499:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 6 pid: 14386 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.374535:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7368d7a00/0x167e6c292403140b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bc2 expref: 6 pid: 14386 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.374549:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:1.0:1788197705.374554:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.374562:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.374568:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.374599:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197705.374652:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2360:x1875060755382656:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 188us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197705.374661:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00080000:0.0:1788197705.374725:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788197705.375525:0:14386:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.375537:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.375562:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.375584:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.375593:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197705.385998:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788197705.386016:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.386028:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.388276:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.388295:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197705.388300:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.388388:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.388410:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c704a46500) 00010000:00010000:2.0:1788197705.388414:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197705.388419:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.388426:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c29240314a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197705.388488:0:14386:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068f3e9e9 reply state 000000005766f3f8 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197705.388498:0:14386:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197705.388778:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+10:14432:x1875060755382528:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 23065us (23230us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788197705.388789:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 19 00010000:00010000:1.0:1788197705.395058:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.395075:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.395083:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.395104:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197705.395109:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.395134:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.395150:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c7106b7200) 00010000:00010000:1.0:1788197705.395154:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197705.395158:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.395164:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031600/0x167e6c29240314ac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197705.478150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197705.479047:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755382784 00000100:00100000:0.0:1788197705.479058:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755382784 00000100:00100000:0.0:1788197705.479136:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:0.0:1788197705.479146:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+9:14440:x1875060755382784:12345-192.168.206.40@tcp:101:lctl.0 00010000:00010000:0.0:1788197705.479185:0:16612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197705.479208:0:16612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c29240314b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bec expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.479273:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c29240314ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.479287:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c29240314ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.479298:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c29240314ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197705.479330:0:16612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788197705.479333:0:16612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197705.479366:0:16612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c29240314ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.479390:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c29240314b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bec expref: 11 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.479408:0:16612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3c00/0x167e6c29240314ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bec expref: 10 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.479417:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:0.0:1788197705.479419:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197705.479423:0:16612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7414f3c00, rc 0) 00000100:00100000:0.0:1788197705.479491:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+10:14440:x1875060755382784:12345-192.168.206.40@tcp:101:lctl.0 Request processed in 346us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197705.479507:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 20 00000100:00100000:0.0:1788197705.496808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.497114:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755382912 00000100:00100000:1.0:1788197705.497125:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755382912 00000100:00100000:1.0:1788197705.497186:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:1.0:1788197705.497260:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:14441:x1875060755382912:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197705.497281:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197705.497302:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240314c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bf3 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.497363:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c29240314c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.497376:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c29240314c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.497386:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c29240314c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197705.497425:0:14387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788197705.497627:0:14387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197705.497650:0:14387:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c29240314c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.497673:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240314c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bf3 expref: 7 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.497689:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfe00/0x167e6c29240314c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bf3 expref: 6 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.497697:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:1.0:1788197705.497700:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788197705.497704:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abfe00, rc 0) 00000100:00100000:1.0:1788197705.497895:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:14441:x1875060755382912:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 638us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197705.497904:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 21 00000100:00100000:2.0:1788197705.501538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197705.501649:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755383040 00000100:00100000:0.0:1788197705.501659:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755383040 00000100:00100000:0.0:1788197705.501728:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:0.0:1788197705.501738:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+6:14441:x1875060755383040:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:0.0:1788197705.501756:0:16612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197705.501777:0:16612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c29240314cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5bfa expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502103:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502118:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502130:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502144:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502151:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502159:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502288:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2800/0x167e6c29240314e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502308:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2800/0x167e6c29240314e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502316:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2800/0x167e6c29240314e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788197705.502346:0:16612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788197705.502350:0:16612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788197705.502369:0:16612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2800/0x167e6c29240314e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502381:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502388:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502395:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502401:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f3200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197705.502405:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502412:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502424:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:0.0:1788197705.502427:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197705.502432:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502448:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3200/0x167e6c29240314d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502462:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502468:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502474:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502478:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f3800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197705.502481:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502487:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502495:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c719ede400) 00010000:00010000:0.0:1788197705.502497:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197705.502500:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502506:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f3800/0x167e6c29240314dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502536:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2000/0x167e6c29240314cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bfa expref: 8 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502563:0:16612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2800/0x167e6c29240314e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bfa expref: 7 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197705.502571:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c719ede000) 00010000:00010000:0.0:1788197705.502574:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788197705.502576:0:16612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7414f2800, rc 0) 00000100:00100000:0.0:1788197705.502644:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+7:14441:x1875060755383040:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 906us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197705.502651:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 22 00000100:00100000:2.0:1788197705.513094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.513306:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755383296 00000100:00100000:1.0:1788197705.513315:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755383296 00000100:00100000:1.0:1788197705.513375:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:1.0:1788197705.513386:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+7:14441:x1875060755383296:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197705.513405:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197705.513424:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240314eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c01 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197705.513516:0:14387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788197705.513644:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240314eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c01 expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.513689:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:1.0:1788197705.513693:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197705.513699:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240314eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c01 expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.513713:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf200, rc 0) 00000100:00100000:1.0:1788197705.513782:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+8:14441:x1875060755383296:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 398us (698us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788197705.513790:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 23 00000100:00100000:1.0:1788197705.517304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197705.517421:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755383552 00000100:00100000:3.0:1788197705.517429:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755383552 00000100:00100000:3.0:1788197705.517483:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:3.0:1788197705.517493:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+8:14441:x1875060755383552:12345-192.168.206.40@tcp:36:lfs.0 00010000:00010000:3.0:1788197705.517542:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197705.517566:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2800/0x167e6c29240314e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5bfa expref: 8 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.517584:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c719ede000) 00010000:00010000:3.0:1788197705.517605:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788197705.517641:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.517654:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.517664:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788197705.518128:0:14388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b4581f1 reply state 0000000024822cf8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197705.518137:0:14388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788197705.518146:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788197705.519418:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+9:14441:x1875060755383552:12345-192.168.206.40@tcp:36:lfs.0 Request processed in 1918us (2116us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788197705.519429:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 24 00000100:00100000:0.0:1788197705.521568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:1.0:1788197705.521657:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.521680:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.521688:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.521694:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197705.521699:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.521706:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.521722:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c7065f6600) 00010000:00010000:1.0:1788197705.521726:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788197705.521743:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.521750:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386e00/0x167e6c29240314f9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197705.522184:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755383808 00000100:00100000:2.0:1788197705.522195:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755383808 00000100:00100000:2.0:1788197705.522241:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1788197705.522251:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c736f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+8:14441:x1875060755383808:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:2.0:1788197705.522468:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c736f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+9:14441:x1875060755383808:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 217us (909us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788197705.522475:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1788197705.525388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.525457:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755384064 00000100:00100000:1.0:1788197705.525466:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755384064 00000100:00100000:1.0:1788197705.525523:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:1.0:1788197705.525534:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+9:14441:x1875060755384064:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:1.0:1788197705.525559:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197705.525579:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c08 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.525659:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.525681:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.525692:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.525706:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.525714:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.525720:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197705.525895:0:14387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788197705.526396:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526404:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526410:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526415:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abea00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197705.526419:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526426:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526439:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:1.0:1788197705.526442:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197705.526446:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526452:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c2924031507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526464:0:14387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526471:0:14387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526489:0:14387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526495:0:14387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfa00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197705.526498:0:14387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526505:0:14387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526513:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c704a46c00) 00010000:00010000:1.0:1788197705.526516:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197705.526519:0:14387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526524:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c292403150e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526564:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031500 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c08 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526574:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:1.0:1788197705.526577:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197705.526580:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c08 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.526589:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf200, rc 0) 00000100:00100000:1.0:1788197705.527119:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+10:14441:x1875060755384064:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 1583us (1735us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788197705.527137:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 25 00000100:00100000:0.0:1788197705.540748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.540873:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755384192 00000100:00100000:2.0:1788197705.540883:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755384192 00000100:00100000:2.0:1788197705.541276:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:2.0:1788197705.541288:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+10:14441:x1875060755384192:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197705.541313:0:16612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197705.541335:0:16612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403151c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c0f expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.541420:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.541448:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.541460:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197705.541488:0:16612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788197705.541491:0:16612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197705.541507:0:16612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.541532:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403151c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 12 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.541550:0:16612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 11 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.541557:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c7106b7600) 00010000:00010000:2.0:1788197705.541561:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788197705.541563:0:16612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:2.0:1788197705.541626:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+11:14441:x1875060755384192:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 340us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197705.541633:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 26 00000100:00100000:1.0:1788197705.545085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.545206:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755384320 00000100:00100000:2.0:1788197705.545215:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755384320 00000100:00100000:2.0:1788197705.545269:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:2.0:1788197705.545279:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+11:14441:x1875060755384320:12345-192.168.206.40@tcp:37:lfs.0 00000100:00100000:2.0:1788197705.549424:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+11:14441:x1875060755384320:12345-192.168.206.40@tcp:37:lfs.0 Request processed in 4135us (4338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197705.549446:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:0.0:1788197705.555642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.555728:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755384576 00000100:00100000:1.0:1788197705.555738:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755384576 00000100:00100000:1.0:1788197705.555801:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:1.0:1788197705.555812:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737197c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+11:14441:x1875060755384576:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197705.556076:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737197c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+12:14441:x1875060755384576:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 265us (442us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788197705.556085:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:0.0:1788197705.611508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.611610:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755384704 00000100:00100000:2.0:1788197705.612001:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755384704 00000100:00100000:2.0:1788197705.612074:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:2.0:1788197705.612087:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+10:14447:x1875060755384704:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197705.612108:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197705.612129:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403152a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c16 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612193:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612207:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612217:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612233:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612240:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612257:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612355:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403153f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612383:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403153f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612390:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403153f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197705.612420:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788197705.612424:0:14386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197705.612460:0:14386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403153f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612472:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612479:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612485:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612490:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031800 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197705.612495:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612501:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612512:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:2.0:1788197705.612515:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197705.612520:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612536:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c2924031531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612554:0:14386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612559:0:14386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612565:0:14386:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612570:0:14386:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197705.612572:0:14386:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612578:0:14386:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612586:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93c7106b7500) 00010000:00010000:2.0:1788197705.612588:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788197705.612591:0:14386:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612596:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c2924031538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612633:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403152a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c16 expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612661:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030800/0x167e6c292403153f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c16 expref: 11 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.612668:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c7106b7600) 00010000:00010000:2.0:1788197705.612670:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788197705.612673:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030800, rc 0) 00000100:00100000:2.0:1788197705.612727:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+11:14447:x1875060755384704:12345-192.168.206.40@tcp:101:bash.0 Request processed in 642us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197705.612735:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 27 00000100:00100000:0.0:1788197705.618629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197705.618719:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755384960 00000100:00100000:3.0:1788197705.618729:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755384960 00000100:00100000:3.0:1788197705.618789:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 28 00000100:00100000:3.0:1788197705.618801:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+11:14447:x1875060755384960:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:3.0:1788197705.618862:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197705.618894:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c2924031546 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c1d expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.619037:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.619052:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 11 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.619073:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.619105:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 11 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.619120:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 11 pid: 16612 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197705.619133:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776347392:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197705.619234:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c708dddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788197705.623569:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776347392:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197705.623597:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197705.624430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.626252:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755385088 00000100:00100000:2.0:1788197705.626265:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755385088 00010000:00010000:2.0:1788197705.626308:0:16500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 12 pid: 16612 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197705.626396:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:2.0:1788197705.626407:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+12:2360:x1875060755385088:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197705.626421:0:16500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197705.626428:0:16500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 12 pid: 16612 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.626440:0:16500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 12 pid: 16612 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.626462:0:16500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031523 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c0f expref: 12 pid: 16612 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.626497:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c7106b7600) 00010000:00010000:2.0:1788197705.626502:0:16500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.626511:0:16500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.626519:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.626550:0:16500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197705.626608:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+11:2360:x1875060755385088:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 202us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197705.626624:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00010000:00010000:3.0:1788197705.627440:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.627452:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.627476:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.627486:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.627507:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628540:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628552:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628560:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197705.628570:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788197705.628597:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628603:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628609:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628614:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701387c00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197705.628618:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628624:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628646:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c7106b7600) 00010000:00010000:3.0:1788197705.628649:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788197705.628654:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628859:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c292403154d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788197705.628877:0:14388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009aeac765 reply state 00000000ee6598f2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197705.628890:0:14388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788197705.628933:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c2924031546 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628947:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.628955:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:3.0:1788197705.628957:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788197705.628960:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701386000, rc 0) 00000100:00100000:3.0:1788197705.629043:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+14:14447:x1875060755384960:12345-192.168.206.40@tcp:101:bash.0 Request processed in 10244us (10436us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788197705.629051:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 28 00010000:00010000:1.0:1788197705.634053:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.634072:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.634081:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.634087:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701387000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197705.634093:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.634111:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.634403:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93c7065f6200) 00010000:00010000:1.0:1788197705.634407:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197705.634412:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197705.634433:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387000/0x167e6c2924031554 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197705.642988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.643544:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755385216 00000100:00100000:2.0:1788197705.643554:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755385216 00000100:00100000:2.0:1788197705.643627:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:2.0:1788197705.643639:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+13:14447:x1875060755385216:12345-192.168.206.40@tcp:101:bash.0 00010000:00010000:2.0:1788197705.643664:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197705.643685:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031569 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c24 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.643752:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.643766:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.643795:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197705.643874:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788197705.643878:0:14386:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197705.643896:0:14386:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.643908:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.643933:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031569 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 15 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.643952:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 14 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.643962:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:2.0:1788197705.643965:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197705.643968:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031e00, rc 0) 00000100:00100000:2.0:1788197705.644038:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+14:14447:x1875060755385216:12345-192.168.206.40@tcp:101:bash.0 Request processed in 400us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197705.644046:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 29 00000100:00100000:0.0:1788197705.647950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.648104:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755385472 00000100:00100000:1.0:1788197705.648113:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755385472 00000100:00100000:1.0:1788197705.648180:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1788197705.648191:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+14:14447:x1875060755385472:12345-192.168.206.40@tcp:35:bash.0 00000100:00100000:1.0:1788197705.648534:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+15:14447:x1875060755385472:12345-192.168.206.40@tcp:35:bash.0 Request processed in 343us (592us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788197705.648542:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1788197705.716807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.716948:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755385728 00000100:00100000:2.0:1788197705.716958:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755385728 00000100:00100000:2.0:1788197705.717028:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:2.0:1788197705.717039:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+15:14457:x1875060755385728:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197705.717060:0:16612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197705.717091:0:16612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c2b expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197705.717180:0:16612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788197705.717450:0:16612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031577 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c2b expref: 17 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.717471:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93c719ede200) 00010000:00010000:2.0:1788197705.717474:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788197705.717480:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c2b expref: 17 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.717766:0:16612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030200, rc 0) 00000100:00100000:2.0:1788197705.717933:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+16:14457:x1875060755385728:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 894us (1137us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788197705.717941:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 30 00000100:00100000:0.0:1788197705.724913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.730071:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755385984 00000100:00100000:1.0:1788197705.730085:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755385984 00000100:00100000:1.0:1788197705.730156:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:1.0:1788197705.730167:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+16:14457:x1875060755385984:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197705.730413:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+17:14457:x1875060755385984:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 246us (5508us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788197705.730422:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:0.0:1788197705.766541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197705.766631:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755386240 00000100:00100000:2.0:1788197705.766641:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755386240 00000100:00100000:2.0:1788197705.766752:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:2.0:1788197705.766775:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+17:14460:x1875060755386240:12345-192.168.206.40@tcp:101:lfs.0 00010000:00010000:2.0:1788197705.766799:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197705.766817:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031585 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c32 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.767119:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403158c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.767133:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403158c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.767159:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403158c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197705.767171:0:14386:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788197705.767283:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031585 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c32 expref: 20 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.767301:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403158c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c32 expref: 19 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197705.767310:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:2.0:1788197705.767313:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788197705.767317:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030e00, rc 0) 00000100:00100000:2.0:1788197705.767378:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+19:14460:x1875060755386240:12345-192.168.206.40@tcp:101:lfs.0 Request processed in 616us (846us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788197705.767386:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 31 00000100:00100000:0.0:1788197705.770368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197705.770479:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755386368 00000100:00100000:3.0:1788197705.770487:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755386368 00000100:00100000:3.0:1788197705.770530:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:3.0:1788197705.770538:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+19:14460:x1875060755386368:12345-192.168.206.40@tcp:54:lfs.0 00010000:00010000:3.0:1788197705.770597:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770612:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770637:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770661:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770668:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770674:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770680:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386a00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:3.0:1788197705.770685:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770692:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770704:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:3.0:1788197705.770707:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788197705.770711:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.770716:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c292403159a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197705.770793:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+19:14460:x1875060755386368:12345-192.168.206.40@tcp:54:lfs.0 Request processed in 254us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197705.770801:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 32 00000100:00100000:0.0:1788197705.773437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197705.773469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197705.773542:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755386752 00000100:00100000:1.0:1788197705.773553:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755386752 00000100:00100000:1.0:1788197705.773607:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:1.0:1788197705.773618:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+19:14460:x1875060755386752:12345-192.168.206.40@tcp:35:lfs.0 00000100:00100000:1.0:1788197705.773865:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+20:14460:x1875060755386752:12345-192.168.206.40@tcp:35:lfs.0 Request processed in 248us (394us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788197705.773873:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:3.0:1788197705.774431:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755386496 00000100:00100000:3.0:1788197705.774437:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755386496 00000100:00100000:3.0:1788197705.774483:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:3.0:1788197705.774490:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c760e63f-6b9c-472f-8180-474aecfbc764+20:2359:x1875060755386496:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788197705.774500:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788197705.774520:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030e00/0x167e6c292403158c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c32 expref: 20 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197705.774537:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:3.0:1788197705.774541:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788197705.774566:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c760e63f-6b9c-472f-8180-474aecfbc764+19:2359:x1875060755386496:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 77us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197705.774572:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00010000:00010000:0.0:1788197705.838191:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788197706.059517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197706.060865:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755387008 00000100:00100000:1.0:1788197706.060879:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755387008 00000100:00100000:1.0:1788197706.060972:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:1.0:1788197706.060991:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+19:14491:x1875060755387008:12345-192.168.206.40@tcp:101:cat.0 00010000:00010000:1.0:1788197706.061016:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197706.061036:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240315a1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c39 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.061147:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240315a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.061162:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240315a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.061555:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240315a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197706.061585:0:14387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788197706.061727:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240315a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c39 expref: 22 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.061745:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240315a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c39 expref: 21 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.061754:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:1.0:1788197706.061757:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197706.061760:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abee00, rc 0) 00000100:00100000:1.0:1788197706.062609:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+21:14491:x1875060755387008:12345-192.168.206.40@tcp:101:cat.0 Request processed in 1615us (3097us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788197706.062634:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 33 00000100:00100000:0.0:1788197706.076759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197706.076913:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755387136 00000100:00100000:2.0:1788197706.076923:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755387136 00000100:00100000:2.0:1788197706.076994:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:2.0:1788197706.077005:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c760e63f-6b9c-472f-8180-474aecfbc764+21:2357:x1875060755387136:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788197706.077020:0:14372:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197706.077044:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abee00/0x167e6c29240315a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c39 expref: 21 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.077071:0:14372:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:2.0:1788197706.077075:0:14372:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788197706.077145:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c760e63f-6b9c-472f-8180-474aecfbc764+20:2357:x1875060755387136:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 141us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197706.077153:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:3.0:1788197706.083419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197706.086157:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755387392 00000100:00100000:1.0:1788197706.086169:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755387392 00000100:00100000:1.0:1788197706.086233:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1788197706.086243:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+20:14491:x1875060755387392:12345-192.168.206.40@tcp:35:cat.0 00000100:00100000:1.0:1788197706.086530:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c760e63f-6b9c-472f-8180-474aecfbc764+21:14491:x1875060755387392:12345-192.168.206.40@tcp:35:cat.0 Request processed in 287us (3119us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788197706.086537:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 8 00000100:00100000:1.0:1788197706.146671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197706.146737:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755387648 00000100:00100000:3.0:1788197706.146747:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755387648 00000100:00100000:3.0:1788197706.147017:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:3.0:1788197706.147030:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+21:14497:x1875060755387648:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:3.0:1788197706.147053:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788197706.147072:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c29240315b6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c40 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.147164:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.147177:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 22 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.147405:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 22 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.147413:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.147442:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 22 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.147454:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 22 pid: 14386 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197706.147468:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776347520:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197706.147570:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 22 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.147580:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 22 pid: 14388 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197706.147589:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c605583480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776347648:192.168.206.40@tcp:104: 00000100:00100000:3.0:1788197706.147613:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c70990b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788197706.150327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197706.150387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197706.150416:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755387776 00000100:00100000:0.0:1788197706.150424:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755387776 00010000:00010000:0.0:1788197706.150462:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 23 pid: 14386 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197706.150492:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755387904 00000100:00100000:0.0:1788197706.150495:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755387904 00010000:00010000:0.0:1788197706.150508:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 24 pid: 14388 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197706.150529:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1788197706.150538:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737c30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+24:2358:x1875060755387776:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197706.150550:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197706.150556:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 24 pid: 14386 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150569:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 24 pid: 14386 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150590:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:0.0:1788197706.150595:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150603:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150609:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197706.150653:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737c30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+24:2358:x1875060755387776:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 115us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197706.150667:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:0.0:1788197706.150709:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:0.0:1788197706.150716:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+23:2358:x1875060755387904:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197706.150724:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197706.150730:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 23 pid: 14388 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150740:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 23 pid: 14388 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150752:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:0.0:1788197706.150755:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150776:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150783:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.150800:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197706.150858:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+23:2358:x1875060755387904:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197706.150864:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00010000:00010000:3.0:1788197706.152159:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031570 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c24 expref: 22 pid: 14386 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197706.152182:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776347520:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197706.152225:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386000/0x167e6c292403155b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c1d expref: 21 pid: 14388 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197706.152237:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c605583480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776347648:192.168.206.40@tcp:104: 00010000:00010000:3.0:1788197706.152259:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.152268:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.152274:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788197706.152291:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788197706.152445:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c701386a00/0x167e6c29240315b6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c40 expref: 22 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.152460:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c701387c00/0x167e6c29240315bd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c40 expref: 21 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197706.152468:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:3.0:1788197706.152471:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788197706.152474:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c701387c00, rc 0) 00000100:00100000:3.0:1788197706.152530:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+21:14497:x1875060755387648:12345-192.168.206.40@tcp:101:dd.0 Request processed in 5503us (5869us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788197706.152537:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 34 00000100:00100000:1.0:1788197706.156645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197706.156725:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755388160 00000100:00100000:2.0:1788197706.156734:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755388160 00000100:00100000:2.0:1788197706.156859:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 35 00000100:00100000:2.0:1788197706.156870:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+21:14497:x1875060755388160:12345-192.168.206.40@tcp:36:dd.0 00000040:00080000:3.0:1788197706.158595:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788197706.159024:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.159041:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.159052:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197706.159123:0:14386:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788197706.159165:0:14386:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000463343da reply state 00000000e951296d transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197706.159176:0:14386:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197706.159548:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+24:14497:x1875060755388160:12345-192.168.206.40@tcp:36:dd.0 Request processed in 2676us (2909us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788197706.159558:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 35 00000020:00080000:2.0:1788197706.159563:0:14386:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788197706.162575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00010000:00010000:0.0:1788197706.162674:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.162686:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.162701:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.162708:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197706.162712:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.162721:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.162740:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:0.0:1788197706.162743:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197706.162748:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.162754:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c29240315cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197706.163703:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755388288 00000100:00100000:1.0:1788197706.163717:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755388288 00000100:00100000:1.0:1788197706.163798:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:1.0:1788197706.163810:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+23:14497:x1875060755388288:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:1.0:1788197706.163862:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197706.163891:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240315d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c47 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.163961:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240315d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c47 expref: 24 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.163984:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240315d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c47 expref: 24 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197706.164003:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:1.0:1788197706.164006:0:14387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197706.164021:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abea00, rc 0) 00000100:00100000:1.0:1788197706.164077:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+24:14497:x1875060755388288:12345-192.168.206.40@tcp:101:dd.0 Request processed in 270us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197706.164085:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 36 00000100:00100000:3.0:1788197706.177424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197706.177636:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755388544 00000100:00100000:0.0:1788197706.177646:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755388544 00000100:00100000:0.0:1788197706.177710:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:0.0:1788197706.177721:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+24:14497:x1875060755388544:12345-192.168.206.40@tcp:103:dd.0 00010000:00010000:0.0:1788197706.177736:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197706.177974:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abea00/0x167e6c29240315d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c47 expref: 24 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.178001:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:0.0:1788197706.178006:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197706.178067:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+23:14497:x1875060755388544:12345-192.168.206.40@tcp:103:dd.0 Request processed in 347us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197706.178087:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:1.0:1788197706.180500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197706.180579:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755388672 00000100:00100000:0.0:1788197706.180588:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755388672 00000100:00100000:0.0:1788197706.180643:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:0.0:1788197706.180653:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+23:14497:x1875060755388672:12345-192.168.206.40@tcp:58:dd.0 00010000:00010000:0.0:1788197706.180743:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.180768:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197706.180779:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788197706.182134:0:14387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788197706.182308:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788197706.182373:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788197706.182683:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+23:14497:x1875060755388672:12345-192.168.206.40@tcp:58:dd.0 Request processed in 2027us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197706.182694:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 37 00000100:00100000:3.0:1788197706.185535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197706.185605:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755388800 00000100:00100000:2.0:1788197706.185615:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755388800 00000100:00100000:2.0:1788197706.185672:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:2.0:1788197706.185683:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+23:14497:x1875060755388800:12345-192.168.206.40@tcp:101:dd.0 00010000:00010000:2.0:1788197706.185700:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197706.185731:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c4e expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.185792:0:14386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.185802:0:14386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c4e expref: 24 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.185818:0:14386:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.185857:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c4e expref: 24 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.185869:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:2.0:1788197706.185871:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197706.185875:0:14386:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c4e expref: 24 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197706.185881:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031800, rc 0) 00000100:00100000:2.0:1788197706.186314:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+24:14497:x1875060755388800:12345-192.168.206.40@tcp:101:dd.0 Request processed in 631us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197706.186321:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 38 00000100:00100000:3.0:1788197706.354223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197706.354272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197706.354397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197706.354428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197706.354477:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755388928 00000100:00100000:0.0:1788197706.354487:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755388928 00000100:00100000:0.0:1788197706.354541:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:0.0:1788197706.354552:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:2359:x1875060755388928:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:0.0:1788197706.354614:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a63de8f9-77dc-4699-8515-61ab34d36ea1+13:2359:x1875060755388928:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 64us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197706.354627:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 122 00000100:00100000:3.0:1788197706.358354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197706.358494:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755389056 00000100:00100000:2.0:1788197706.358504:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755389056 00000100:00100000:2.0:1788197706.358564:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755389312 00000100:00100000:2.0:1788197706.358568:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755389312 00000100:00100000:2.0:1788197706.358584:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755389184 00000100:00100000:2.0:1788197706.358587:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755389184 00000100:00100000:2.0:1788197706.358624:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:2.0:1788197706.358633:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755389056:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197706.358699:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755389056:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 67us (4486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197706.358707:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:2.0:1788197706.358724:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1788197706.358731:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755389312:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197706.358755:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755389312:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 26us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197706.358931:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:2.0:1788197706.358945:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:2.0:1788197706.358953:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755389184:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197706.358989:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c605583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755389184:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 37us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197706.358996:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00080000:2.0:1788197706.359014:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788197706.359018:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788197706.362368:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755389440 00000100:00100000:2.0:1788197706.362383:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755389440 00000100:00100000:2.0:1788197706.362471:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:2.0:1788197706.362482:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755389440:12345-192.168.206.40@tcp:400:kworker.0 00000100:00100000:2.0:1788197706.362557:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b63d12c-2667-4384-9d52-ebbdc0b3cd6b+5:2359:x1875060755389440:12345-192.168.206.40@tcp:400:kworker.0 Request processed in 77us (4212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197706.362565:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00080000:3.0:1788197706.365074:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788197706.863182:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788197707.182114:0:14419:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788197707.182122:0:14419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788197707.182157:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788197707.182165:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788197707.182348:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c737007100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14419:1875060776347776:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788197707.182497:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c708dddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788197707.197568:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c737007100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14419:1875060776347776:192.168.206.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788197707.201043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197707.201359:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755389568 00000100:00100000:3.0:1788197707.201369:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755389568 00000100:00100000:3.0:1788197707.201439:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:3.0:1788197707.201450:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c760e63f-6b9c-472f-8180-474aecfbc764+24:14499:x1875060755389568:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788197707.201544:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c760e63f-6b9c-472f-8180-474aecfbc764+24:14499:x1875060755389568:12345-192.168.206.40@tcp:900:lhsmtool_posix.0 Request processed in 95us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788197707.201551:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00080000:2.0:1788197707.201742:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788197707.204385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.204474:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755389696 00000100:00100000:1.0:1788197707.204485:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755389696 00000100:00100000:1.0:1788197707.204548:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:1.0:1788197707.204558:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+24:14499:x1875060755389696:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788197707.204585:0:14388:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788197707.204684:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+24:14499:x1875060755389696:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 126us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.204692:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 39 00000100:00100000:0.0:1788197707.209129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.209469:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755389824 00000100:00100000:1.0:1788197707.209479:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755389824 00000100:00100000:1.0:1788197707.209542:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:1.0:1788197707.209552:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+24:14499:x1875060755389824:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788197707.209621:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209637:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209649:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209711:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209730:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209738:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209762:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209771:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209778:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197707.209815:0:16612:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788197707.209820:0:16612:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788197707.209857:0:16612:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209868:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209875:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209882:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209888:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfa00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.209892:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209907:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209920:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c719edea00) 00010000:00010000:1.0:1788197707.209923:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197707.209928:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209934:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abfa00/0x167e6c29240315e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209947:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209953:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209980:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209986:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.209989:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.209995:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212132:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93c704a46c00) 00010000:00010000:1.0:1788197707.212136:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197707.212141:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212167:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c29240315ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212191:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212198:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212205:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212211:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.212214:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212222:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212230:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:1.0:1788197707.212232:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197707.212235:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.212241:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c29240315f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197707.212335:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+24:14499:x1875060755389824:12345-192.168.206.40@tcp:34:lhsmtool_posix.0 Request processed in 2779us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.212345:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 40 00000100:00100000:3.0:1788197707.218190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.218464:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755390080 00000100:00100000:1.0:1788197707.218476:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755390080 00000100:00100000:1.0:1788197707.218537:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:1.0:1788197707.218548:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+24:14499:x1875060755390080:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197707.218567:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197707.218585:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c29240315fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c55 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218671:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218686:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218698:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788197707.218709:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788197707.218798:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218806:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218813:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218818:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe400 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.218868:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218876:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218903:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:1.0:1788197707.218906:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788197707.218910:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218916:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031603 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218956:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c29240315fc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c55 expref: 26 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218967:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93c719edea00) 00010000:00010000:1.0:1788197707.218970:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788197707.218986:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c29240315fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c55 expref: 26 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.218996:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf600, rc 0) 00000100:00100000:1.0:1788197707.219159:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+25:14499:x1875060755390080:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 613us (978us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788197707.219167:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 41 00000100:00100000:3.0:1788197707.224920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.225034:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755390208 00000100:00100000:2.0:1788197707.225042:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755390208 00000100:00100000:2.0:1788197707.225097:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:2.0:1788197707.225109:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+25:14499:x1875060755390208:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788197707.225143:0:14386:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788197707.225269:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+25:14499:x1875060755390208:12345-192.168.206.40@tcp:53:lhsmtool_posix.0 Request processed in 161us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197707.225277:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 42 00000100:00100000:0.0:1788197707.230489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.230581:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755390464 00000100:00100000:1.0:1788197707.230591:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755390464 00000100:00100000:1.0:1788197707.230651:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:1.0:1788197707.230661:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+25:14499:x1875060755390464:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197707.230679:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197707.230704:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031611 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c5c expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788197707.231580:0:14388:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1788197707.231589:0:14388:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788197707.231640:0:14388:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788197707.231991:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031618 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.232005:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031618 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.232015:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031618 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.232075:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031611 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c5c expref: 28 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.232092:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031618 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c5c expref: 27 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.232099:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c704a46c00) 00010000:00010000:1.0:1788197707.232102:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788197707.232105:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abe400, rc 0) 00000100:00100000:1.0:1788197707.232163:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+27:14499:x1875060755390464:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 1502us (1684us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788197707.232172:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 43 00000100:00100000:3.0:1788197707.237169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.237813:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755390720 00000100:00100000:1.0:1788197707.237840:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755390720 00000100:00100000:1.0:1788197707.237991:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:1.0:1788197707.238002:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+27:14499:x1875060755390720:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788197707.238068:0:16612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197707.238091:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe400/0x167e6c2924031618 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c5c expref: 27 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238107:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c704a46c00) 00010000:00010000:1.0:1788197707.238115:0:16612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788197707.238135:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238147:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238156:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238168:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238175:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238195:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238265:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238272:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238278:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238290:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.238295:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238301:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238309:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93c7106b7600) 00010000:00010000:1.0:1788197707.238311:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197707.238314:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238320:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031626 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238330:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238336:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238342:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238347:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abe200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.238349:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238356:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238374:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x71e85b25 (ffff93c704a46d00) 00010000:00010000:1.0:1788197707.238377:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197707.238380:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.238385:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abe200/0x167e6c292403162d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71e85b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16612 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197707.238468:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+26:14499:x1875060755390720:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 466us (1307us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788197707.238475:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 44 00000100:00100000:3.0:1788197707.240968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.241612:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755390848 00000100:00100000:2.0:1788197707.241623:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755390848 00000100:00100000:2.0:1788197707.241724:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:2.0:1788197707.241736:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+26:14499:x1875060755390848:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197707.241866:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197707.241890:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924031634 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c63 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.241925:0:14386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030400/0x167e6c292403163b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.241937:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030400/0x167e6c292403163b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.241948:0:14386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030400/0x167e6c292403163b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14386 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.242061:0:14386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924031634 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c63 expref: 28 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.242078:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030400/0x167e6c292403163b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c63 expref: 27 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.242087:0:14386:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:2.0:1788197707.242090:0:14386:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788197707.242093:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700030400, rc 0) 00000100:00100000:2.0:1788197707.242203:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+27:14499:x1875060755390848:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 468us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197707.242209:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 45 00000100:00100000:3.0:1788197707.244817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.244911:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755391104 00000100:00100000:2.0:1788197707.244920:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755391104 00000100:00100000:2.0:1788197707.244983:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 46 00000100:00100000:2.0:1788197707.244993:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+27:14499:x1875060755391104:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788197707.245067:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.245081:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.245093:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788197707.245513:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788197707.245524:0:14387:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 503391701286ns, next at 504391698537ns, rc = 0 00000004:00010000:2.0:1788197707.245620:0:14387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000420c3a4c reply state 00000000a895281c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.245630:0:14387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197707.247007:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+29:14499:x1875060755391104:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 2008us (2191us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788197707.247017:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 46 00010000:00010000:1.0:1788197707.248961:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.248987:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.248994:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.248999:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031000 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.249004:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.249011:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.249026:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:1.0:1788197707.249029:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788197707.249046:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.249053:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031000/0x167e6c2924031642 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197707.249443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.249516:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755391232 00000100:00100000:1.0:1788197707.249525:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755391232 00000100:00100000:1.0:1788197707.249611:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:1.0:1788197707.249619:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+28:14499:x1875060755391232:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788197707.249637:0:16612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788197707.249651:0:16612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c6a expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.249696:0:16612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 29 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.249705:0:16612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 29 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.249717:0:16612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:1.0:1788197707.249720:0:16612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788197707.249722:0:16612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c736abf200, rc 0) 00000100:00100000:1.0:1788197707.249771:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+29:14499:x1875060755391232:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.249776:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 47 00000100:00100000:0.0:1788197707.252137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.255466:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755391360 00000100:00100000:1.0:1788197707.255481:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755391360 00000100:00100000:1.0:1788197707.255582:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:1.0:1788197707.255607:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c760e63f-6b9c-472f-8180-474aecfbc764+5:2359:x1875060755391360:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788197707.255938:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c760e63f-6b9c-472f-8180-474aecfbc764+6:2359:x1875060755391360:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 331us (3806us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788197707.255945:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 12 00000100:00100000:3.0:1788197707.261810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.262153:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755391616 00000100:00100000:2.0:1788197707.262162:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755391616 00000100:00100000:2.0:1788197707.262223:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:2.0:1788197707.262233:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+29:14499:x1875060755391616:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788197707.262432:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+30:14499:x1875060755391616:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 200us (631us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788197707.262440:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 9 00000100:00100000:3.0:1788197707.266819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.269857:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755391872 00000100:00100000:1.0:1788197707.269873:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755391872 00000100:00100000:1.0:1788197707.269947:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:1.0:1788197707.269959:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+30:14499:x1875060755391872:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788197707.270151:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+30:14499:x1875060755391872:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 193us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.270160:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 48 00000100:00100000:0.0:1788197707.273613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.273684:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755392000 00000100:00100000:2.0:1788197707.273695:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755392000 00000100:00100000:2.0:1788197707.273813:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:2.0:1788197707.273867:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+30:14499:x1875060755392000:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788197707.273890:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788197707.273910:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924031650 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c71 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.273990:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031657 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.274004:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.274034:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788197707.274071:0:14388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788197707.274090:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.274117:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030a00/0x167e6c2924031650 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c71 expref: 32 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.274135:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c71 expref: 31 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.274143:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:2.0:1788197707.274145:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788197707.274148:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c700031200, rc 0) 00000100:00100000:2.0:1788197707.274219:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+31:14499:x1875060755392000:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 396us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788197707.274227:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 49 00000100:00100000:3.0:1788197707.278165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.280541:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755392128 00000100:00100000:1.0:1788197707.280555:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755392128 00000100:00100000:0.0:1788197707.280725:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:0.0:1788197707.280738:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c760e63f-6b9c-472f-8180-474aecfbc764+6:2360:x1875060755392128:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788197707.280755:0:15072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788197707.280779:0:15072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf35bf7be004d5c78 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788197707.280807:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a95bb4b, blocks: 0x1 00010000:00010000:0.0:1788197707.280840:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1788197707.280846:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.280856:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 7 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.280876:0:15072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 7 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.280889:0:15072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93c7414f3e00, rc 0) 00000100:00100000:0.0:1788197707.280953:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c760e63f-6b9c-472f-8180-474aecfbc764+7:2360:x1875060755392128:12345-192.168.206.40@tcp:101:lhsmtool_posix.0 Request processed in 217us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197707.280959:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:0.0:1788197707.286795:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.287304:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755392384 00000100:00100000:1.0:1788197707.287314:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755392384 00000100:00100000:0.0:1788197707.287509:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:0.0:1788197707.287520:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+31:14499:x1875060755392384:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788197707.287645:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c70838ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c760e63f-6b9c-472f-8180-474aecfbc764+31:14499:x1875060755392384:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 126us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197707.287653:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 50 00000100:00100000:2.0:1788197707.294211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.296731:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755392512 00000100:00100000:1.0:1788197707.296745:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755392512 00000100:00100000:1.0:1788197707.296816:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00100000:1.0:1788197707.296840:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+31:14499:x1875060755392512:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788197707.333145:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:3.0:1788197707.333159:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1788197707.333177:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788197707.333184:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788197707.333191:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788197707.333356:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788197707.333375:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776347904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788197707.333433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197707.333613:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776347904 00000100:00100000:2.0:1788197707.333620:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776347904 00000100:00100000:2.0:1788197707.333743:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788197707.333754:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c708389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776347904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788197707.333928:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788197707.333932:0:15071:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788197707.333934:0:15071:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788197707.333947:0:15071:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788197707 -> 1788197707 00002000:00010000:2.0:1788197707.333950:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788197707.334006:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c708389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875060776347904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (572us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788197707.334014:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788197707.334042:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c760e63f-6b9c-472f-8180-474aecfbc764+21:14499:x1875060755392512:12345-192.168.206.40@tcp:44:lhsmtool_posix.0 Request processed in 37215us (39836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.334051:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 51 00000100:00080000:0.0:1788197707.334134:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788197707.334341:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93c708389500/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788197707.334347:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c708389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776347904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788197707.336882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.337202:0:16460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755392640 00000100:00100000:1.0:1788197707.337212:0:16460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755392640 00000100:00100000:1.0:1788197707.337317:0:16460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:1.0:1788197707.337327:0:16460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c760e63f-6b9c-472f-8180-474aecfbc764+7:2359:x1875060755392640:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788197707.337434:0:16460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c760e63f-6b9c-472f-8180-474aecfbc764+7:2359:x1875060755392640:12345-192.168.206.40@tcp:16:lhsmtool_posix.0 Request processed in 108us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.337441:0:16460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 15 00000100:00100000:3.0:1788197707.340993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.341074:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755392896 00000100:00100000:2.0:1788197707.341082:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755392896 00000100:00100000:2.0:1788197707.341143:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 52 00000100:00100000:2.0:1788197707.341152:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+14:14499:x1875060755392896:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788197707.341203:0:14387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788197707.341227:0:14387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031657 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c71 expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.341247:0:14387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:2.0:1788197707.341252:0:14387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788197707.341278:0:14387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.341289:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.341308:0:14387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788197707.341478:0:14387:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069b4b57c reply state 000000008dee2c4a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.341502:0:14387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788197707.341593:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c760e63f-6b9c-472f-8180-474aecfbc764+15:14499:x1875060755392896:12345-192.168.206.40@tcp:36:lhsmtool_posix.0 Request processed in 441us (620us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788197707.341600:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 52 00010000:00010000:0.0:1788197707.344182:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.344198:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.344207:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.344214:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:0.0:1788197707.344219:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.344228:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.344245:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:0.0:1788197707.344249:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788197707.344253:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.344262:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700030200/0x167e6c2924031665 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197707.344263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.344381:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755393024 00000100:00100000:2.0:1788197707.344389:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755393024 00000100:00100000:2.0:1788197707.344439:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:2.0:1788197707.344448:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+7:2360:x1875060755393024:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788197707.344609:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788197707.344613:0:15071:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788197705 00002000:00010000:2.0:1788197707.344616:0:15071:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788197705 00002000:00010000:2.0:1788197707.344617:0:15071:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788197707 -> 1788197705 00002000:00010000:2.0:1788197707.344620:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788197707.344674:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c760e63f-6b9c-472f-8180-474aecfbc764+8:2360:x1875060755393024:12345-192.168.206.40@tcp:2:lhsmtool_posix.0 Request processed in 227us (415us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788197707.344682:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 16 00000100:00100000:3.0:1788197707.357694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197707.357793:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755393152 00000100:00100000:0.0:1788197707.357802:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755393152 00000100:00100000:0.0:1788197707.357879:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1788197707.357888:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c760e63f-6b9c-472f-8180-474aecfbc764+8:2359:x1875060755393152:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788197707.357925:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.357941:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.357946:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.357951:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.357965:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.358003:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.358012:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.358021:0:15072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.358027:0:15072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f2400 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197707.358042:0:15072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.358051:0:15072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.358065:0:15072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.358074:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8706036/0x167e6c292403166c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197707.358140:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c760e63f-6b9c-472f-8180-474aecfbc764+8:2359:x1875060755393152:12345-192.168.206.40@tcp:1:lhsmtool_posix.0 Request processed in 253us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197707.358147:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 17 00000100:00100000:0.0:1788197707.364577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.364666:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755393408 00000100:00100000:2.0:1788197707.364675:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755393408 00000100:00100000:2.0:1788197707.364728:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 53 00000100:00100000:2.0:1788197707.364737:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c741119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+14:14499:x1875060755393408:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788197707.364818:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.364858:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.364885:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.365110:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.365120:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 15 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.365128:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.365158:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 15 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.365169:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 15 pid: 16612 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.365182:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776348032:192.168.206.40@tcp:104: 00000100:00100000:2.0:1788197707.365280:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433000 going to sleep for 11 seconds 00000100:00100000:0.0:1788197707.368731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.368852:0:16500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755393536 00000100:00100000:1.0:1788197707.368860:0:16500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755393536 00010000:00010000:1.0:1788197707.368900:0:16500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 16 pid: 16612 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197707.368934:0:16500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 13 00000100:00100000:1.0:1788197707.368945:0:16500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c760e63f-6b9c-472f-8180-474aecfbc764+16:2360:x1875060755393536:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788197707.368958:0:16500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788197707.368965:0:16500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 16 pid: 16612 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.368990:0:16500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 16 pid: 16612 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.369012:0:16500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:1.0:1788197707.369016:0:16500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.369026:0:16500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.369034:0:16500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.369054:0:16500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788197707.369117:0:16500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74111aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c760e63f-6b9c-472f-8180-474aecfbc764+16:2360:x1875060755393536:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 173us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.369125:0:16500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 13 00010000:00010000:2.0:1788197707.369506:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf200/0x167e6c2924031649 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c6a expref: 15 pid: 16612 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.369523:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776348032:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197707.369542:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.369551:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.369565:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788197707.369721:0:14388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788197707.369903:0:14388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788197707.369949:0:14388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788197707.370039:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14388:1875060776348160:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788197707.370108:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197707.370321:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788197707.371201:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776348160 00000100:00100000:1.0:1788197707.371209:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776348160 00000100:00100000:1.0:1788197707.371266:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788197707.371277:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14388:x1875060776348160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788197707.371627:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14388:x1875060776348160:12345-0@lo:1000:mdt00_002.0 Request processed in 351us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.371635:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788197707.371715:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14388:1875060776348160:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788197707.372443:0:14388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788197707.372675:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c74133ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14388:1875060776348288:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788197707.372718:0:14388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788197707.372747:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433000 going to sleep for 11 seconds 00000100:00100000:0.0:1788197707.372815:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776348288 00000100:00100000:0.0:1788197707.372846:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776348288 00000100:00100000:0.0:1788197707.372884:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788197707.372892:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c74133ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14388:x1875060776348288:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788197707.373047:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c74133ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14388:x1875060776348288:12345-0@lo:1000:mdt00_002.0 Request processed in 155us (328us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788197707.373055:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788197707.373280:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c74133ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14388:1875060776348288:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788197707.373322:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373331:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373338:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373344:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197707.373348:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373366:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373382:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:2.0:1788197707.373384:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197707.373389:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373396:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c292403167a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373425:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373432:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373437:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373442:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f2e00 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:2.0:1788197707.373445:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373452:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373459:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:2.0:1788197707.373461:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788197707.373609:0:14388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c4e expref: 18 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373634:0:14388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c4e expref: 18 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373644:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c4e expref: 18 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.373673:0:14388:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031800/0x167e6c29240315e0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c4e expref: 18 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.373684:0:14388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776348416:192.168.206.40@tcp:105: 00000100:00100000:2.0:1788197707.373857:0:14388:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c709433000 going to sleep for 11 seconds 00000100:00100000:1.0:1788197707.389656:0:14388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14388:1875060776348416:192.168.206.40@tcp:105: 00010000:00010000:1.0:1788197707.389686:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389696:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c7414f2e00/0x167e6c29240315d9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389727:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389741:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389751:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389762:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389768:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389791:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389796:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abf600 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.389800:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389807:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389819:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:1.0:1788197707.389859:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788197707.389863:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389870:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c736abf600/0x167e6c2924031681 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389880:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389886:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389892:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389897:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc21fc4f0) 00010000:00010000:1.0:1788197707.389900:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389915:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389924:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93c7065f6c00) 00010000:00010000:1.0:1788197707.389926:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788197707.389929:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.389935:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031200/0x167e6c2924031673 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197707.390148:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c741119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c760e63f-6b9c-472f-8180-474aecfbc764+18:14499:x1875060755393408:12345-192.168.206.40@tcp:57:lhsmtool_posix.0 Request processed in 25410us (25579us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788197707.390157:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 53 00000020:00080000:1.0:1788197707.390163:0:14388:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788197707.390409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000040:00080000:0.0:1788197707.390599:0:14419:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788197707.390604:0:14419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788197707.390630:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788197707.390642:0:14419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788197707.390950:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755393664 00000100:00100000:1.0:1788197707.390957:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755393664 00000100:00100000:1.0:1788197707.391012:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1788197707.391021:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737196450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+18:14497:x1875060755393664:12345-192.168.206.40@tcp:49:dd.0 00000100:00100000:1.0:1788197707.391116:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737196450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+18:14497:x1875060755393664:12345-192.168.206.40@tcp:49:dd.0 Request processed in 95us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197707.391123:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 10 00000100:00100000:1.0:1788197707.399073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:2.0:1788197707.399434:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755393920 00000100:00100000:2.0:1788197707.399444:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755393920 00000100:00100000:2.0:1788197707.399509:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 11 00000100:00100000:2.0:1788197707.399519:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+18:14499:x1875060755393920:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788197707.400322:0:14389:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788197707.400537:0:14389:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788197707.400581:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.400596:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.400605:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.400624:0:14389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.400630:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.400636:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.400649:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788197707.400744:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c760e63f-6b9c-472f-8180-474aecfbc764+20:14499:x1875060755393920:12345-192.168.206.40@tcp:35:lhsmtool_posix.0 Request processed in 1224us (1679us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788197707.400751:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 11 00000020:00080000:2.0:1788197707.400755:0:14389:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788197707.400850:0:14375:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788197707.400857:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.400863:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197707.400867:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.400874:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.400886:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93c7106b7500) 00010000:00010000:0.0:1788197707.400889:0:14375:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788197707.400894:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.400900:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93c700031e00/0x167e6c2924031688 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.400912:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197707.400914:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788197707.400916:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788197707.532281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197707.532352:0:15076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394048 00000100:00100000:0.0:1788197707.532361:0:15076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394048 00000100:00100000:0.0:1788197707.532436:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 0 00000100:00100000:0.0:1788197707.532447:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c760e63f-6b9c-472f-8180-474aecfbc764+8:2359:x1875060755394048:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:0.0:1788197707.532478:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.532497:0:15076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 8 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.532519:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.532524:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.532528:0:15076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.532561:0:15076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 8 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.532574:0:15076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 8 pid: 15072 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197707.532588:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c741118700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15076:1875060776348544:192.168.206.40@tcp:104: 00000100:00100000:0.0:1788197707.532685:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff93c711a1c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788197707.541567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197707.541609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197707.541657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197707.541764:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788197707.541774:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788197707.542039:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394176 00000100:00100000:0.0:1788197707.542047:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394176 00000100:00100000:0.0:1788197707.542100:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788197707.542107:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394304 00000100:00100000:0.0:1788197707.542110:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394304 00000100:00100000:0.0:1788197707.542130:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788197707.542134:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394432 00000100:00100000:0.0:1788197707.542137:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394432 00000100:00100000:2.0:1788197707.542631:0:16615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:2.0:1788197707.542643:0:16615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c760e63f-6b9c-472f-8180-474aecfbc764+11:2360:x1875060755394176:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:2.0:1788197707.542679:0:16615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.542697:0:16615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197707.542701:0:16615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197707.542706:0:16615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.542715:0:16615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197707.543732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197707.543776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:3.0:1788197707.543802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.543860:0:15078:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788197707.543869:0:15078:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788197707.543962:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c741118700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15076:1875060776348544:192.168.206.40@tcp:104: 00010000:00010000:2.0:1788197707.543994:0:15076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197707.545386:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788197707.545401:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394560 00000100:00100000:0.0:1788197707.545408:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394560 00000100:00100000:0.0:1788197707.545456:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788197707.545470:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394688 00000100:00100000:0.0:1788197707.545473:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394688 00000100:00100000:0.0:1788197707.545498:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788197707.545654:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394816 00000100:00100000:0.0:1788197707.545658:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394816 00000100:00100000:3.0:1788197707.546426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:0.0:1788197707.546500:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755395072 00000100:00100000:0.0:1788197707.546505:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755395072 00010000:00010000:0.0:1788197707.546529:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 15 pid: 15072 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197707.546560:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1788197707.546578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.40@tcp (source: 12345-192.168.206.40@tcp) 00000100:00100000:1.0:1788197707.546590:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060755394944 00000100:00100000:1.0:1788197707.546594:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060755394944 00000100:00100000:0.0:1788197707.547049:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+16:2359:x1875060755395072:12345-192.168.206.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788197707.547064:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788197707.547088:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 16 pid: 15072 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.547103:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 16 pid: 15072 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.547127:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017b81709/0x167e6c292403165e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.40@tcp remote: 0xf35bf7be004d5c78 expref: 16 pid: 15072 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.547140:0:14373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.547145:0:14373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.547151:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.547161:0:14373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.547703:0:14373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.547707:0:14373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.547712:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.547720:0:14373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.547805:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788197707.547884:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c760e63f-6b9c-472f-8180-474aecfbc764+15:2359:x1875060755395072:12345-192.168.206.40@tcp:103:ldlm_bl.0 Request processed in 1314us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197707.547895:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 14 00000100:00100000:3.0:1788197707.548338:0:16616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:3.0:1788197707.548348:0:16616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c760e63f-6b9c-472f-8180-474aecfbc764+14:2360:x1875060755394304:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:3.0:1788197707.548379:0:16616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.548391:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197707.548400:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197707.548406:0:16616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.548418:0:16616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.549492:0:15076:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.549506:0:15076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.553085:0:16615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.553105:0:16615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788197707.638771:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788197707.638788:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1788197707.638794:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1788197707.638802:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1788197707.639546:0:16616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788197707.639552:0:16616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788197705 -> 1788197707 00002000:00010000:2.0:1788197707.639555:0:16616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788197705 -> 1788197707 00002000:00010000:2.0:1788197707.639558:0:16616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788197707.639571:0:16616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639584:0:16616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639594:0:16616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639602:0:16616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701386a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197707.639607:0:16616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639628:0:16616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639647:0:16616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639656:0:16616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000715dc35a/0x167e6c292403169d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.639730:0:16616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c760e63f-6b9c-472f-8180-474aecfbc764+18:2360:x1875060755394304:12345-192.168.206.40@tcp:4:dd.0 Request processed in 91379us (98116us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788197707.639739:0:16616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 2 00000100:00100000:2.0:1788197707.639768:0:16616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:2.0:1788197707.639779:0:16616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c760e63f-6b9c-472f-8180-474aecfbc764+17:2360:x1875060755394432:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:2.0:1788197707.639808:0:16616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639819:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197707.639856:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197707.639863:0:16616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.639876:0:16616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788197707.680002:0:15076:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1788197707.680011:0:15076:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:1.0:1788197707.680025:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680037:0:15076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680045:0:15076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680052:0:15076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f2800 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197707.680057:0:15076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680065:0:15076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680084:0:15076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680092:0:15076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015001a3c/0x167e6c292403168f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197707.680201:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c760e63f-6b9c-472f-8180-474aecfbc764+19:2359:x1875060755394048:12345-192.168.206.40@tcp:4:dd.0 Request processed in 147752us (147926us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788197707.680212:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 0 00010000:00010000:2.0:1788197707.680336:0:16615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680346:0:16615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680354:0:16615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680361:0:16615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031e00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197707.680364:0:16615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680373:0:16615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680384:0:16615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680392:0:16615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f75aca/0x167e6c2924031696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.680427:0:16615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c760e63f-6b9c-472f-8180-474aecfbc764+17:2360:x1875060755394176:12345-192.168.206.40@tcp:4:dd.0 Request processed in 137787us (138870us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788197707.680435:0:16615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 1 00000100:00100000:2.0:1788197707.680464:0:16615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 4 00000100:00100000:2.0:1788197707.680476:0:16615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c737007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c760e63f-6b9c-472f-8180-474aecfbc764+16:2360:x1875060755394560:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:2.0:1788197707.680505:0:16615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680516:0:16615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197707.680521:0:16615:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788197707.680528:0:16615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.680539:0:16615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197707.680676:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:1.0:1788197707.680685:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c760e63f-6b9c-472f-8180-474aecfbc764+17:2360:x1875060755394688:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:1.0:1788197707.680701:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680710:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197707.680713:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788197707.680718:0:15076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.680726:0:15076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788197707.681697:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788197707.681714:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:1.0:1788197707.723046:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1788197707.723632:0:16616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1788197707.723637:0:16616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788197707.723650:0:16616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.723662:0:16616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.723670:0:16616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.723676:0:16616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700031200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197707.723681:0:16616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.723688:0:16616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.723706:0:16616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.723732:0:16616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece7da6a/0x167e6c29240316a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197707.723859:0:16616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c760e63f-6b9c-472f-8180-474aecfbc764+15:2360:x1875060755394432:12345-192.168.206.40@tcp:4:dd.0 Request processed in 84048us (182166us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788197707.723869:0:16616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 3 00000100:00100000:3.0:1788197707.723909:0:16616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 6 00000100:00100000:3.0:1788197707.723919:0:16616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c760e63f-6b9c-472f-8180-474aecfbc764+14:2360:x1875060755394816:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:3.0:1788197707.723953:0:16616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.723966:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197707.723981:0:16616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788197707.723990:0:16616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.724002:0:16616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788197707.783796:0:15076:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1788197707.783806:0:15076:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:0.0:1788197707.783850:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.783865:0:15076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.783873:0:15076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.783899:0:15076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c736abfa00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:0.0:1788197707.783905:0:15076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.783913:0:15076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.783931:0:15076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.783938:0:15076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e287766/0x167e6c29240316b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788197707.784030:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c760e63f-6b9c-472f-8180-474aecfbc764+16:2360:x1875060755394688:12345-192.168.206.40@tcp:4:dd.0 Request processed in 103341us (240248us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788197707.784040:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 5 00000100:00100000:0.0:1788197707.784073:0:15076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.40@tcp, seq: 7 00000100:00100000:0.0:1788197707.784084:0:15076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c760e63f-6b9c-472f-8180-474aecfbc764+15:2359:x1875060755394944:12345-192.168.206.40@tcp:4:dd.0 00010000:00010000:0.0:1788197707.784113:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.784125:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.784129:0:15076:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788197707.784135:0:15076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788197707.784159:0:15076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.784770:0:16615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.784781:0:16615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.784800:0:16615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.784806:0:16615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c700030200 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:1.0:1788197707.784809:0:16615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.784817:0:16615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.784854:0:16615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788197707.784861:0:16615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ad38f41/0x167e6c29240316ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788197707.784902:0:16615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c737007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c760e63f-6b9c-472f-8180-474aecfbc764+15:2360:x1875060755394560:12345-192.168.206.40@tcp:4:dd.0 Request processed in 104428us (241175us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788197707.784911:0:16615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 4 00000001:00080000:1.0:1788197707.784937:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1788197707.821302:0:16616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:2.0:1788197707.821323:0:16616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.821336:0:16616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.821346:0:16616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.821354:0:16616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c701387a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:2.0:1788197707.821359:0:16616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.821389:0:16616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.821410:0:16616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788197707.821418:0:16616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcd22dfd/0x167e6c29240316b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788197707.821503:0:16616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c760e63f-6b9c-472f-8180-474aecfbc764+11:2360:x1875060755394816:12345-192.168.206.40@tcp:4:dd.0 Request processed in 97582us (277695us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788197707.821513:0:16616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 6 00000001:00080000:1.0:1788197707.823015:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1788197707.858732:0:15076:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788197707.858763:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.858777:0:15076:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.858801:0:15076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.858808:0:15076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93c7414f3a00 already unused, calling callback (ffffffffc17bc230) 00010000:00010000:3.0:1788197707.858813:0:15076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.858852:0:15076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.858876:0:15076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788197707.858884:0:15076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007774ff85/0x167e6c29240316c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788197707.858983:0:15076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7414a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c760e63f-6b9c-472f-8180-474aecfbc764+7:2359:x1875060755394944:12345-192.168.206.40@tcp:4:dd.0 Request processed in 74887us (312389us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788197707.858993:0:15076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.40@tcp, seq: 7 00000001:00080000:1.0:1788197707.859806:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1788197707.888032:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788197708.922040:0:14375:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197709.168149:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776348672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788197709.168219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197709.171978:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776348672 00000100:00100000:1.0:1788197709.171995:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776348672 00000100:00100000:1.0:1788197709.172072:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788197709.172096:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776348672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788197709.172150:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788197709.172229:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776348672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197709.172236:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788197709.172284:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788197709.172290:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93c708389500, transno 8589934595 00000004:00080000:1.0:1788197709.172300:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788197709.172326:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c7417fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776348672:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788197709.172370:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788197709.267611:0:16655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788197709.942047:0:14374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788197710.190005:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788197710.190027:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776348800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788197710.190090:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197710.190191:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776348800 00000100:00100000:1.0:1788197710.190199:0:15074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776348800 00000100:00100000:1.0:1788197710.190264:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788197710.190272:0:15074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c7417fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776348800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788197710.190305:0:15074:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788197710.190347:0:15074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c7417fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875060776348800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197710.190354:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788197710.190710:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788197710.190746:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875060776348800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788197710.193921:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776349184:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.193991:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197710.194027:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788197710.194033:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776349056:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.194058:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197710.194089:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776349056 00000100:00100000:1.0:1788197710.194096:0:15073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776349056 00000100:00100000:1.0:1788197710.194138:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788197710.194147:0:15073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776349056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.194198:0:15073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875060776349056:12345-0@lo:400:kworker.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197710.194205:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788197710.194243:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875060776349056:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.195706:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776349312:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.195757:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197710.195808:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788197710.195816:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776348928:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.195859:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197710.195887:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776349440:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.195908:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788197710.195934:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776349184 00000100:00100000:1.0:1788197710.195940:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776349184 00000100:00100000:1.0:1788197710.195983:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776349312 00000100:00100000:1.0:1788197710.195987:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776349312 00000100:00100000:1.0:1788197710.196007:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776349440 00000100:00100000:1.0:1788197710.196010:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776349440 00000100:00100000:1.0:1788197710.196023:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788197710.196031:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776349184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.196077:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875060776349184:12345-0@lo:400:kworker.0 Request processed in 47us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197710.196084:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788197710.196099:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788197710.196105:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776349312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.196135:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875060776349312:12345-0@lo:400:kworker.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197710.196152:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788197710.196165:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788197710.196171:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776349440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.196200:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875060776349440:12345-0@lo:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788197710.196206:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788197710.196225:0:14381:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788197710.196251:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875060776349184:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.196276:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875060776349440:0@lo:400:kworker.0 00000100:00100000:1.0:1788197710.196284:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875060776349312:0@lo:400:kworker.0 00000100:00100000:0.0:1788197710.197195:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875060776348928 00000100:00100000:0.0:1788197710.197204:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875060776348928 00000100:00100000:0.0:1788197710.197249:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788197710.197257:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93c73cfb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:3313:x1875060776348928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788197710.197316:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93c73cfb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb9dfa30-4633-465a-85d4-89e35609b060+19:3313:x1875060776348928:12345-0@lo:400:kworker.0 Request processed in 60us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788197710.197323:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788197710.197361:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93c73c1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb9dfa30-4633-465a-85d4-89e35609b060:3313:1875060776348928:0@lo:400:kworker.0 Debug log: 29429 lines, 29429 kept, 0 dropped, 0 bad.